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EXECUTIVE  SUMMARY 

The  Omnibus  Budget  Reconciliation  Act  (OBRA)  of  1981  altered 
federal  requirements  concerning  Medicaid  in  a  number  of  ways.  One 
important  change — stemming  from  Section  2175  of  OBRA--gave  states 
new  flexibility  to  institute  programs  for  limiting  Medicaid 
enrollees'  freedom  of  choice  of  provider.  An  important  federal 
objective  underlying  this  legislative  change  was  to  encourage  the 
states  to  seek  alternative,  lower  cost  ways  of  providing  the 
Medicaid  population  with  medically  necessary  care.  Several  states 
developed  case  management  (CM)  programs  following  OBRA's  passage. 
This  study  evaluates  the  accomplishments  of  one  of  these 
programs,  specifically,  the  one  developed  by  the  State  of  Utah. 

Utah  had  two  basic  reasons  for  wanting  to  limit  recipients' 
freedom  of  choice.  First,  the  state  expected  to  save  money  by 
controlling  recipients'  access  to  health  care  services.  State 
officials  believed  that  complete  freedom  of  choice  permitted 
behavior  that  inflated  the  cost  of  the  Medicaid  program.  It  was 
felt  that  many  recipients  relied  upon  multiple  health  care 
providers,  resulting  in  duplicative  and  excessive  use  of  medical 
resources.  Moreover,  there  was  concern  that  many  recipients 
turned  too  readily  to  expensive  emergency  rooms  for  nonemergency 
care,  rather  than  seeking  care  from  the  less  expensive 
alternative,  namely,  a  primary  care  physician. 

Second,  the  state  argued  that  its  program  for  controlling 
recipients'  access  to  health  care  services  would  actually  enhance 
access  and  improve  the  quality  of  care  for  many  Medicaid 
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enrollees.  Access  improvements  were  anticipated  for  two 
reasons.  First,  by  assigning  enrollees  to  specific  physicians  or 
an  HMO,  each  enrollee  would  know  immediately  whom  to  contact  when 
the  need  for  medical  care  arose.  Under  the  earlier  (pre-OBRA) 
freedom-of -choice  arrangements,  enrollees  were  responsible  for 
finding  their  own  health  care  providers;  of  course,  such 
providers  had  to  be  willing  to  accept  Medicaid  patients.  Since 
only  about  20  to  25  percent  of  all  physicians  in  Utah  accepted 
Medicaid  patients,  this  undoubtedly  represented  an  access  problem 
for  some  enrollees,  which  could  be  avoided  under  the  proposed 
"gatekeeper"  program,  where  they  would  be  assigned  to  a 
participating  physician.  Second,  state  officials  hoped  that  the 
new  program  would  encourage  more  physicians  to  participate  in 
Medicaid,  thereby  further  enhancing  enrollees'  access  to  medical 
care.  Improvements  in  the  quality  of  care  received  by  Medicaid 
clients  were  anticipated  because  Utah's  case  management  program 
replaced  a  system  that  permitted  episodic,  uncoordinated  care 
from  a  variety  of  providers  with  one  that  assures  continuity  of 
care    through    a    primary   care   case   manager. 

The  goals  and  design  of  the  case  management  program  imply 
the  following  hypotheses--al 1  of  which  are  tested  in  this 
study--concerning  the  impact  of  CM  on  recipient  utilization 
patterns: 

o      Increased   recipient   use   of   primary   care   providers; 

o      Reduced    nonemergency   use   of   ERs    and   OPDs; 

o      Reduced    use    of    specialists;    and 
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o   Reduced  use  of  prescription  drugs. 
These  hypotheses  arise  not  only  from  the  goals  and  design  of  the 
CM  program,  but  also  from  preliminary  evidence  generated  by  an 
early  state  assessment  of  the  impact  of  case  management. 

To  acheive  both  the  cost  containment  and  access  objectives, 
the  savings  from  reductions  in  unnecessary  use  must  more  than 
offset  increases  in  outlays  arising  from  access 
enhancements.  Framed  in  terms  of  a  testable  hypothesis: 

o  case  management  lowers  overall  program  costs. 
The  empirical  investigation  relies  upon  a  two-part  model  of 
utilization  behavior,  that  focuses  first  on  the  factors  affecting 
whether  a  Medicaid  enrollee  uses  any  amount  of  a  medical  service, 
and  then  on  the  factors  influencing  the  level  of  use  among  those 
actually  using  a  service.  Separate  probability  and  level-of-use 
equations  are  estimated  for  several  Medicaid-covered  ambulatory 
services,  all  measured  at  the  level  of  the  individual  Medicaid* 
client.  Specifically,  these  include: 

o    Primary  care  physician  services; 

o    Specialist  services; 

o    ER/OPD  services; 

o   Clinic  services; 

o    Hospital-based  physician  services;  and 

o    Prescription  drugs. 
These  equations  were  estimated  with  data  provided  by  the  State  of 
Utah. 
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Do  the  findings  support  acceptance  or  rejection  of  the 
hypotheses  concerning  the  impact  of  case  management?  The  answer 
is  mixed:  some  receive  support  from  the  findings,  while  others  do 
not. 

Primary  care  physician  services.  Case  management  was 
expected  to  increase  recipient  use  of  primary  care  providers.  The 
evidence  suggests  that  this  objective  was  achieved.  Case 
management  raises  the  likelihood  of  contact  during  a  month  by  33 
percent,  a  highly  significant  impact.  However,  it  does  not  seem 
to  alter  the  level  of  use  among  users:  paid  claims  per  month 
(adjusted  for  other  factors)  are  essentially  the  same  for  both 
groups. 

Specialists'  services.  An  important  goal  of  Utah's  case 
management  program  is  reducing  the  use  of  specialists' 
services.  The  estimates  imply  that  the  program  has  fallen  short 
with  respect  to  this  objective.  The  predicted  likelihood  of 
seeing  a  specialist  is  actually  greater  among  the  case  managed 
group,  although  the  difference  does  not  attain  statistical 
significance.  Moreover,  no  difference  in  the  level  of  use  among 
users  in  the  treatment  and  control  groups  was  detected.  While  the 
evidence  does  not  support  the  inference  that  case  management 
raises  the  use  of  specialists'  services,  it  clearly  supports 
rejection  of  the  notion  that  case  management  lowers  the  use  of 
special ists . 

Hospital  ER/OPD  services.  In  part,  case  management  was 
designed  to  lower  the  nonemergency  use  of  hospital  ERs  and 
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OPDs.  The  evidence  indicates  that,  on  balance,  case  management 
attained  modest  savings  in  the  use  of  ER/OPD  services.  Compared 
to  the  control  group,  expected  dollar  claims  for  case  managed 
enrollees  were  11.5  percent  lower.  Notably,  this  aggregate 
savings  was  achieved  through  a  combination  of  1)  heightened 
likelihood  of  using  ER/OPD  services  during  a  month  (25  percent 
greater  among  the  case  managed),  but  2)  reduced  level  of  use 
among  the  users  of  these  services  (29  percent  less  among  the  case 
managed) . 

Prescription  drugs.  Reducing  the  use  of  prescription  drugs 
was  another  objective  of  the  case  management  program.  The 
findings  indicate  clearly  that  this  objective  was  not 
achieved.  To  the  contrary,  prescription  drug  use  appears  to  have 
risen  by  statistically  significant  amounts  under  case 
management.  Compared  to  the  controls,  case  managed  enrollees  are 
42  percent  more  likely  to  use  prescription  drug  services  during  a 
month.  Further,  among  those  obtaining  prescription  drugs,  the 
level  of  use  (as  measured  by  paid  claims)  simply  seems  unaffected 
by  case  management.  The  combined  effect  results  in  a  substantial 
increase  (of  about  42  percent)  in  expected  dollar  claims  per  case 
managed  enrollee. 

Cost  containment.  Lowering  overall  costs  for  the  Medicaid 
program  was  the  principal  federal  motive  for  the  case  management 
idea.  Indeed,  early  estimates  by  the  State  of  Utah  suggested 
substantial  savings  from  case  management.  However,  the  evidence 
does  not  confirm  the  notion  that  case  management  ultimately  saves 
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money.  In  connection  with  five  of  the  six  services  investigated, 
case  management  seems  to  raise  the  cost  of  providing  care  for 
Medicaid  recipients.  A  weighted  average  of  the  predicted  effects 
for  all  of  the  services  provides  an  image  of  the  overall  cost 
implications  of  case  management.  Across  all  six  services,  case 
management  raises  expected  dollar  claims  per  Medicaid  enrollee  by 
25  percent,  after  adjusting  for  other  factors. 

Over  the  long  run,  or  under  different  administrative 
arrangements  and  with  different  incentives  to  providers,  this 
particular  estimate  of  added  cost  from  case  management  might 
vary.  For  example,  some  of  the  higher  use  observed  might  be 
transitory — both  as  a  result  of  the  newly  case-managed  population 
"trying  out"  their  new  primary  care  physicians  and  as  a  result  of 
treating  the  pent-up  health  needs  of  a  relatively  underserved 
population.  On  the  other  hand,  the  effectiveness  of  the 
gatekeeper  in  holding  down  doctor-shopping  and  self-referrals 
might  be  reduced  over  the  longer  run  as  recipients  learn  ways  to 
beat  the  system.  Only  with  strong  economic  incentives  for  primary 
care  providers  to  reduce  enrollees'  total  use  does  it  seem  likely 
that  Utah's  CM  program  can  achieve  its  cost  containment  objective 
simultaneously  with  increased  access. 
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The  Omnibus  Budget  Reconciliation  Act  (OBRA)  of  1981  altered 
federal  requirements  concerning  Medicaid  in  a  number  of  ways.  One 
important  change — stemming  from  Section  2175  of  OBRA — gave  states 
new  flexibility  to  institute  programs  for  limiting  Medicaid 
enrollees'  freedom  of  choice  of  provider.  Subject  to  approval  of 
the  Secretary  of  Health  and  Human  Services,  a  state  was  permitted 
under  OBRA  to  implement  a  case  management  (CM)  program  which 
restricts  individual  enrollees  to  a  single  provider  for  all 
nonemergency  primary  care.  Approval  from  the  Secretary  hinges  on 
the  state  satisfying  two  key  requirements:  1)  the  CM  restrictions 
must  not  "substantially  impair  access"  to  primary  care  services 
of  "adequate  quality  where  medically  necessary;"  and  2)  they  must 
be  "cost  effective."  Clearly,  the  federal  objective  underlying 
this  legislative  change  was  to  encourage  the  states  to  seek 
alternative,  lower  cost  ways  of  providing  the  Medicaid  population 
with  medically  necessary  care. 

Several  states  developed  CM  programs  following  OBRA's 
passage  (see,  e.g.,  Fruend,  1984).  This  study  evaluates  the 
accomplishments  of  one  of  these  programs,  specifically,  the  one 
developed  by  the  State  of  Utah.l 

The  findings  of  this  investigation  are  described  in  this 
report,  which  is  organized  in  the  following  way.  The  next  section 
provides  background  information  necessary  for  understanding  the 
key  features  of  Utah's  case  management  program.  Section  II  lays 
out  the  research  hypotheses,  which  stem  basically  from  the  stated 
goals  of  the  program.  The  research  methodology  is  presented  in 
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Section  III.  The  results  of  the  empirical  analyses  are  reported 
in  Section  IV.  The  final  section  contains  a  discussion  of  the 
findings. 

I.  BACKGROUND 

In  response  to  the  new  flexibility  provided  by  OBRA ,  the 
State  of  Utah  applied  for  a  waiver  of  the  "freedom  of  choice" 
requirements  governing  its  Medicaid  program  in  November 
1981.  Essentially,  Utah  wanted  permission  to  assign  each  Medicaid 
enrollee  either  1)  to  a  specific  primary  care  physician--a 
"gatekeeper"  or  "case  manager " --who  would  have  complete 
responsibility  for  providing,  or  arranging  for,  the  enrollee's 
primary,  nonemergency  health  care;  or  2)  to  a  health  maintenance 
organization  (HMO),  which  would  have  the  same  type  of 
responsibilities  as  the  physician  gatekeepers. 2  This  request  was 
approved  in  March  1982,  and  implementation  of  Utah's  Choice  of 
Health   Care   Delivery    (CHCD)    program   began    in   August    1982. 

In  its  first  couple  of  months,  the  program  was  limited  to 
Salt  Lake  County,  which  encompasses  Salt  Lake  City  and  thus 
contains  about  40  percent  of  Utah's  population  (which  equalled 
1.5  million  in  1980).  In  October  1982,  the  CHCD  program  was 
extended  northward  to  the  neighboring  counties  of  Davis  and 
Weber,  which  jointly  contain  about  20  percent  of  the  state's 
population.  In  January  1983,  it  was  extended  southward  into 
neighboring  Utah  County,  covering  another  15  percent  of  the 
state's    population. 3    The     remaining  25        percent    of     the 

state's     population     is     scattered     across     25     largely     rural 
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counties.  Due  to  administrative  problems  and  limited  availability 
of  Medicaid  providers  in  these  rural  areas,  the  CHCD  program  was 
not  extended  into  them,  at  least  not  during  the  time  period 
pertinent    to    this    study. 

There  were  two  basic  reasons  for  wanting  to  limit 
recipients'  freedom  of  choice. 4  First,  the  state  expected  to  save 
money  by  controlling  recipients'  access  to  health  care 
services.  State  officials  believed  that  complete  freedom  of 
choice  permitted  behavior  that  inflated  the  cost  of  the  Medicaid 
program.  It  was  felt  that  many  recipients  relied  upon  multiple 
health  care  providers,  resulting  in  duplicative  and  excessive  use 
of  medical  resources.  Moreover,  there  was  concern  that  many 
recipients  turned  too  readily  to  expensive  emergency  rooms  for 
nonemergency  care,  rather  than  seeking  care  from  the  less 
expensive   alternative,    namely,    a   primary    care   physician. 

Second,  the  state  argued  that  its  program  for  controlling 
recipients'  access  to  health  care  services  would  actually  enhance 
access  and  improve  the  quality  of  care  for  many  Medicaid 
enrollees.  Access  improvements  were  anticipated  for  two 
reasons.  First,  by  assigning  enrollees  to  specific  physicians  or 
an  HMO,  each  enrollee  would  know  immediately  whom  to  contact  when 
the  need  for  medical  care  arose.  Under  the  earlier  (pre-OBRA) 
freedom-of -choice  arrangements,  enrollees  were  responsible  for 
finding  their  own  health  care  providers;  of  course,  such 
providers  had  to  be  willing  to  accept  Medicaid  patients.  Since 
only    about    20    to    25    percent    of    all    physicians     in    Utah    accepted 
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Medicaid  patients,  this  undoubtedly  represented  an  access  problem 
for  some  enrollees,  which  could  be  avoided  under  the  proposed 
"gatekeeper"  program,  where  they  would  be  assigned  to  a 
physician.  Second,  state  officials  hoped  that  the  new  program 
would  encourage  more  physicians  to  participate  in  Medicaid, 
thereby  further  enhancing  enrollees'  access  to  medical 
care.  Improvements  in  the  quality  of  care  received  by  Medicaid 
clients  were  anticipated  because  the  CHCD  program  replaced  a 
system  that  permitted  episodic,  uncoordinated  care  from  a  variety 
of  providers  with  one  that  assures  continuity  of  care  through  a 
primary  care  case  manager. 

In  translating  these  general  goals  into  specific  testable 
hypotheses,  it  is  essential  to  understand  some  of  the  details  of 
the  CHCD  program;  the  remainder  of  this  section  is  devoted  to 
this  task.  In  the  end,  data  limitations  restrict  the  empirical 
analysis  to  those  enrollees  selecting  a  case  manager  rather  than 
an  HMO.  Accordingly,  the  following  discussion  of  the  salient 
features  of  the  CHCD  program  concentrates  on  the  case  management 
(CM)  portion.  Further,  it  is  organized  around  the  two  general 
goals  of  cost  containment  and  enhanced  access. 
Cost  Containment 

Achievement  of  the  cost  containment  objective  hinges  on 
controlling  recipients'  use  of  nonemergency  medical  services  by 
requiring  them  to  go  through  a  gatekeeper,  that  is,  their  case 
manager.  Essentially,  two  things  need  to  happen.  First,  Medicaid 
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enrollees  must  find  access  to  nonemergency  care  from  anyone  other 
than  their  gatekeeper  (or  someone  authorized  by  their  gatekeeper) 
diminished  greatly,  if  not  entirely  eliminated.  Second,  the 
gatekeepers  actually  have  to  restrict  their  Medicaid  clients'  use 
of  unnecessary  medical  services.  In  what  ways  is  the  CHCD  program 
designed  to  assure  that  these  things  happened? 

Enrollee  participation  in  the  CHCD  program  was  assured  by 
making  it  mandatory.  As  part  of  the  eligibility  determination 
processes  enrollees  are  required  to  either  join  an  HMO  or  select 
a  case  manager.  Since  the  choice  is  made  as  part  of  a  personal 
interview  with  a  Medicaid  representative,  it  is  difficult  to 
avoid,  although  not  entirely  impossible,  at  least  for  a  limited 
period  of  time6.  when  an  enrollee  chooses  the  HMO  option,  the 
representative  forwards  the  enrollee's  name  to  the  participating 
HMO,  which  then  contacts  the  recipient  directly  (Bell, 
1986).  Those  selecting  case  management  must  choose  a  specific 
physician,  whose  willingness  to  serve  as  case  manager  is  then 
confirmed  by  telephone.  If  that  physician  declines,  the  process 
is  repeated  until  a  willing  case  manager  is  found. 

Tying  enrollment  in  the  CHCD  program  to  the  eligibility 
determination  (and  re-determination)  process  assured  that  the 
program  would  be  phased-in  gradually.  Indeed,  by  December  198  3, 
when  the  program  was  more  than  a  year  old,  only  about  50  percent 
of  all  eligible  Medicaid  clients  had  enrolled  in  the  CHCD 
program. 7 
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Once  a  case  manager  is  identified,  his  or  her  name  is 
printed  on  the  enrollee's  Medicaid  card,  and  is  supposed  to 
appear  on  each  subsequent  card  received  by  the  enrollee,8  Placing 
the  case  manager's  name  on  the  Medicaid  card  serves  two 
purposes:  1)  it  reminds  enrollees  who  to  contact  for  medical 
care;  but  more  importantly,  2)  it  also  announces  to  other 
providers  that  giving  a  Medicaid  client  care  not  authorized  by 
the  indicated  gatekeeper  may  result  in  an  unpaid  claim. 9  Probably 
as  much  as  anything  else,  this  aspect  of  the  CHCD  program  helps 
direct  Medicaid  enrollees  to  their  gatekeeper  for  nonemergency 
medical  care. 

Enrollees  can  switch  c a s e ■ ma n a g e r s ,  although  not 
easily:  changes  made  within  a  year  of  the  initial  assignment  to  a 
case  manager  must  be  justified  during  a  personal  interview  with  a 
Medicaid  representative.  Presumably,  this  provision  makes  it 
difficult  for  enrollees  to  shop  around  for  case  managers  who  are 
ineffective  at  controlling  recipients'  unnecessary  use  of  medical 
services . 

This  last  point  naturally  raises  the  issue  of  whether  case 
managers  will  actually  control  recipients'  use  of  medical 
services.  Program  rules  stipulate  that  case  managers  are 
responsible  for  either  providing  or  authorizing  all  nonemergency 
care  for  their  Medicaid  patients.  Yet,  the  program  contains  few, 
if  any,  incentives  for  encouraging  physicians  to  act  as 
conscientious  case  managers  for  their  Medicaid  patients.  Case 
managers  are  paid  standard  Medicaid  rates  for  medical  services 
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rendered.  They  are  not  paid  a  separate  case  management  fee;  and 
they  are  not  financially  "at  risk"  for  their  Medicaid  clients' 
medical  expenses.  Further,  while  referrals  to  specialists  require 
case  managers  to  initiate  a  referral  form  (with  a  copy  going  to 
Medicaid  officials),  this  requirement  imposes  no  real  barrier  to 
unnecessary  referrals;  in  fact,  case  managers  can  refer  Medicaid 
patients  to  specialists  without  even  making  a  clinical  assessment 
(Fruend,  p.  35).  Thus,  case  managers  are  neither  rewarded 
directly  for  effective  performance  as  a  gatekeeper,  nor  penalized 
for  ineffective  performance. 10  In  short,  the  design  of  the  CHCD 
program  provides  case  managers  with  no  obvious  reason,  other  than 
perhaps  a  moral  obligation,  to  help  the  Medicaid  program  save 
money. 
Enhanced  Access 

The  CHCD  program  contains  several  features  which,  in 
principle,  could  enhance  enrollees'  access  to  health  care 
services.  First,  the  enrollment  procedures  should  facilitate  some 
access  improvements.  In  selecting  a  case  manager,  Medicaid 
clients  are  assisted  by  a  program  representative,  who  both  helps 
in  making  the  selection  and  then  telephones  to  confirm  the 
physician's  willingness  to  serve  as  case  manager.  Moreover,  the 
physician's  agreement  is  confirmed  by  mail,  and  his  or  her  name 
is  printed  on  the  enrollee's  Medicaid  card.  All  of  these  steps 
assure  that  every  CHCD  participant  has  a  case  manager  who  has 
agreed  to  provide  enrollees  with  24-hour  access  to  primary, 
nonemergency  health  care  services. 11  Presumably,  this  represents 


an  improvement  in  access  for  at  least  some,  if  not  many,  Medicaid 
beneficiaries. 

Second,  in  order  to  encourage  physician  participation  in  the 
CHCD  program,  no  restrictions  were  imposed  on  physicians'  freedom 
to  reject  Medicaid  patients.  Serving  as  a  case  manager  for  one 
Medicaid  client  would  not  obligate  a  physician  to  become  a  case 
manager  for  others.  Moreover,  a  physician  can  disenroll  a 
Medicaid  patient  from  the  practice's  caseload  at  any  time,  so 
agreeing  to  become  a  case  manager  does  not  lock  a  physician  into 
a  long-term  obligation.  While  this  freedom  may  work  to  the 
disadvantage  of  some  Medicaid  enrollees,  it  probably  serves,  on 
balance,  to  enhance  recipient  access  by  lowering  the  cost  of 
participation  to  physicians,  thereby  encouraging  their 
involvement  in  the  program. 

Physician  participation  was  further  encouraged  by  the  fact 
that  all  Utah  physicians,  including  specialists,  are  potentially 
eligible  to  serve  as  primary  care  case  managers.  The  only 
essential  requirement  for  participation  is  that  physicians  must 
agree  to  abide  by  the  rules  of  the  CHCD  program  (e.g.,  provide 
24-hour  access  to  "necessary"  medical  services). 

In  contrast  to  the  foregoing  features  of  the  CHCD  program, 
its  reimbursement  aspects  probably  serve  both  to  encourage 
physician  participation  and  discourage  it.  The  program's 
f ee-f or-service  arrangement  for  paying  physicians  is  presumably 
attractive  to  them,  even  though  the  levels  of  the  fees  may  be 
seen  as  too  low.  Another  reimbursement  feature  physicians 
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presumably  find  appealing  is  the  Medicaid  program's  acceptance  of 
the  financial  risk  for  the  Medicaid  clients:  in  other  words,  the 
case  managers  are  not  financially  responsible  for  the  medical 
expenses  of  their  Medicaid  patients.  The  financial  disincentive 
in  the  reimbursement  arrangements  arises  from  the  failure  of  the 
CHCD  program  to  pay  case  managers  a  separate  fee  for  their  case 
management  services.  Asking  physicians  to  accept  more 
responsibility  for  their  Medicaid  patients  without  offering  some 
corresponding  financial  reward  undoubtedly  strikes  some 
physicians  as  unreasonable,  leaving  them  unwilling  to  participate 
in    the   CHCD   program. 

II.    HYPOTHESES 

The  stated  objectives  of  the  CHCD  program  and  the  specific 
details  of  its  design  imply  a  number  of  testable  research 
hypotheses.  This  study  investigates  empirically  several  of  these 
hypotheses,  but  others  are  not  pursued  because  of  data 
limitations.  The  following  discussion  concentrates  on  those 
hypotheses  actually  investigated  here,  but  also  notes  those  left 
unexami  ned. 

One  of  the  principal  objectives  of  the  CHCD  program  is  to 
better  manage  recipients'  use  of  medical  services.  In  practice, 
this  objective  translates  essentially  into  one  of  changing  the 
mix  of  services  received  by  Medicaid  patients.  Specifically,  the 
goals  and  design  of  the  case  management  program  imply  the 
following     hypo t he ses --a  1 1     of     which     are     tested      in     this 
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study--concer ning  the  impact  of  CM  on  recipient  utilization 
patterns : 

o   Increased  recipient  use  of  primary  care  providers; 

o   Reduced  nonemergency  use  of  ERs  and  OPDs; 

o   Reduced  use  of  specialists; 

o  Reduced  use  of  prescription  drugs. 
These  hypotheses  arise  not  only  from  the  goals  and  design  of  the 
CM  program,  but  also  from  preliminary  evidence  generated  by  an 
early  state  assessment  of  the  impact  of  case  management.  Based 
upon  these  preliminary  findings,  the  State  of  Utah  feels  that,  in 
the  first  year  of  the  program,  the  CM  program  1)  lowered  dollar 
claims  for  ER  services  for  case-managed  Medicaid  clients  by  36 
percent;  and  2)  reduced  the  number  of  pharmacy  claims  per  client 
by  12  percent. 12 

In  addition  to  the  foregoing  impacts,  CM  should  reduce  the 
extent  of  doctor  shopping  (e.g.,  resulting  in  a  lowering  of  the 
average  number  of  physicians  seen  by  recipients)  and  other  forms 
of  duplicative  use  of  medical  services, 13  while  at  the  same  time 
improving  the  quality  of  care  by  assuring  continuity  of  care 
through  primary  care  providers.  However,  these  particular 
effects--or  hypotheses — cannot  be  assessed  with  the  data  employed 
in  this  study,  and,  thus,  are  not  considered  further. 

Another  important  objective  of  the  CHCD  program  is  cost 
containment.  While  the  program  was  supposed  to  improve  access  to 
primary  health  care  services,  it  was  also  designed  to  reduce 
unnecessary  utilization.  The  savings  from  reductions  in 
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unnecessary  use  were  expected  to  more  than  offset  increases  in 
outlays  arising  from  access  enhancements.  Framed  in  terms  of  a 
testable  hypothesis: 

o  case  management  lowers  overall  program  costs. 
Preliminary  findings  by  the  state  of  Utah  provide  seemingly 
strong  support  for  this  hypothesis.  The  assessment  of  early 
evidence  by  the  state  resulted  in  a  first-year  savings  estimate 
of  $1.3  million,  which  translates  into  $4.30  saved  for  every  $1 
invested  in  the  program. 14 

III.  METHODS 
Research  Design 

A  valid  test  of  the  foregoing  hypotheses  requires  a  research 
design  capable  of  isolating  the  effect  of  case  management  on 
Medicaid  program  expenditure  patterns  and  levels.  The  design 
adopted  for  this  study  is  a  standard  one,  relying  upon 
cross-sectional  comparisons  between  a  "treatment  group"  of 
case-managed  enrollees  and  a  "control  group"  of  Medicaid  clients 
eligible  for  case  management  but  not  yet  enrolled  into  the  CM 
program. 15  It  was  possible  to  establish  the  treatment  and  control 
groups  in  this  way  because  CM  was  phased-in  slowly,  leaving 
thousands  of  Medicaid  clients  eligible  for  CM,  but  unenrolled  for 
many   months. 

Under  ideal  circumstances,  treatment  and  control  groups  are 
established  through  random  assignment  of  individuals  to  the  two 
groups,     thereby    minimizing,     if    not    eliminating,     inter-group 
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differences  capable  of  confounding  the  estimated  effect  of  the 
treatment  (in  this  instance,  case  management).  Since  Medicaid 
clients  were  obviously  not  assigned  randomly  to  case  management, 
it  is  necessary  to  rely  upon  multivariate  statistical  methods  to 
control  for  potentially  confounding  differences  between  the 
treatment  and  control  groups. 

However,  even  with  statistical  controls  for  observable 
differences  in  demographic  characteristics  (e.g.,  age  or  sex), 
the  possibility  remains  that  unobserved  differences  between  the 
groups,  arising  from  the  way  people  get  assigned  to  one  group  or 
the  other,  will  still  result  in  biased  estimates  of  the  effect  of 
case  management.  (This  problem  is  usually  labelled  "selection 
bias.")  To  illustrate  the  nature  of  the  problem  more  fully, 
consider  the  implications  of  an  enrollment  process  that  allows 
Medicaid  clients  with  sufficient  determination  to  evade  case 
management  for  extended  periods.  In  all  likelihood,  the 
motivation  to  avoid  case  management  is  greater  among  high  users 
of  Medicaid  services  than  among  low  users.  Thus,  during  the  early 
stages  of  implementation,  the  case-managed  population  could 
easily  exhibit  lower  utilization  rates  than  the  control  group, 
even  if  case  management  itself  were  completely  ineffective  at 
controlling  use,  simply  because  the  enrollment  process  creates 
underlying  inter-group  differences  in  the  propensity  to  use 
medical  services.  Clearly,  the  research  design  must  address  this 
problem  of  selection  bias  in  order  to  isolate  the  effect  of  case 
management  on  utilization  and  expenditure  patterns. 
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This  study  handles  the  selection-bias  problem  by  controlling 
statistically  for  individual  differences  in  "prior  use,"  that  is, 
observed  utilization  for  a  time  period  immediately  preceding  that 
employed  for  the  utilization  comparisons  between  the  treatment 
and  control  groups. 16  The  presumption  is  that  differences  in 
prior  use  rates  will  tend  to  reflect  underlying  variation  in  the 
propensity  to  use  medical  services.  Thus,  controlling  for 
differences  in  prior  use  helps  control  for  this  unobservable 
propensity  to  use  health  services,  thereby  enhancing  the  accuracy 
of  the  estimates  of  case  management's  impact  on  Medicaid 
expenditure  patterns. 
Empirical    Model 

The  empirical  investigation  relies  upon  a  two-part  model  of 
utilization  behavior  (see,  e.g..  Manning).  This  model  focuses 
first  on  1)  the  factors  affecting  whether  a  Medicaid  enrollee 
uses  any  amount  of  a  medical  service,  and  then  on  2)  the  factors 
influencing  the  level  of  use  among  those  actually  using  a 
service. 

Separate  probability  and  level-of-use  equations  are 
estimated  for  several  Medicaid-covered  ambulatory  services,  all 
measured  at  the  level  of  the  individual  Medicaid 
client.    Specifically,    these    include: 

o        Primary   care   physician   services; 

o        Specialist    services; 

o         ER/OPD    services; 

o        Clinic    services; 
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o    Hospital-based  physician  services; 

o    Prescription  drugs. 
The  estimating  equations  make  these  dependent  variables  a 
function  of  several  independent  variables.  The  key  independent 
variable  reflects: 

o  whether  or  not  a  Medicaid  enrollee 
is  case  managed. 
The  remaining  independent  variables  control  for  factors  other 
than  case  management  that  could  cause  inter-group  variation  in 
utilization  rates  and  cloud  the  assessment  of  case  management' 
effect.  These  other  variables  control  for  the  individual 
client ' s : 

o    age; 

o   sex ; 

o   race; 

o        county    of    residence;    and, 

o        prior    use    of    Medicaid    services. 17 
Data 

The  research  design  employed  in  this  study  establishes 
certain  minimal  requirements  for  the  analytic  data 
file.  Essentially,  the  design  requires  1)  person-level 
information,  since  the  individual  Medicaid  client  serves  as  the 
unit  of  analysis;  2)  observations  on  Medicaid  clients  who  were 
case  managed  for  the  entire  period  covered  by  the  analysis  (i.e., 
the  treatment  group);  3)  data  on  others  who  were  enrolled  in 
Medicaid     for     the    entire    analysis    period,     but     not     case    managed 
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(i.e.,  the  control  group);  4)  measures  of  utilization  among  the 
treatment  and  control  group  members  both  during  and  prior  to  the 
time  period  selected  for  the  analysis;  and  5)  information 
necessary  for  developing  the  other  control  variables  in  the 
multivariate  model. 

Under  ideal  circumstances,  these  requirements  could  be 
satisfied  by  drawing  upon  two  different,  but  related, 
databases:  1)  a  Medicaid  enrollment  file  and  2)  Medicaid  claims 
files.  The  former  permits  accurate  identification  of  all  Medicaid 
enrollees,  the  period  of  time  spanned  by  their  eligibility,  and 
whether  they  were  case  managed,  among  other  things.  The  latter 
provides  information  on  the  use  of  Medicaid-covered  services, 
along  with  other  information  also  available  from  the  enrollment 
file    (e.g.,    age,    sex,    race,    case  management    status). 

V7hile  the  State  of  Utah  provided  the  Medicaid  claims  files 
for  all  of  1983  and  the  first  half  of  1984,  it  did  not, 
unfortunately,  grant  access  to  the  Medicaid  enrollment 
file.  Consequently,  it  was  necessary  to  base  the  entire 
evaluation  on  information  extracted  from  the  claims  files 
alonelB. 

In  light  of  this  constraint  on  data,  aggregating  the 
claims-level  data  into  person-level  observations  was  the  only  way 
to  satisfy  the  research  design's  requirement  concerning  the  unit 
of  analysis. 19  While  this  approach  to  creating  a  person-level 
data  file  is  costly  and  time-consuming,  it  is  nevertheless 
feasible.    However,     it     also     limits     the     analysis     to     Medicaid 
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recipients  (as  opposed  to  all  Medicaid  enrollees),  since  claims 
are    submitted,    by   definition,    for    recipients    of   services    only. 

Identification  of  appropriate  observations  for  inclusion  in 
the  treatment  and  control  groups  is  also  complicated  by  the  lack 
of  an  enrollment  file.  One  problem  stems  from  the  fact  that 
claims  files  offer  only  partial  glimpses  of  a  person's 
eligibility  for  Medicaid  services.  Eligibility  for  Medicaid  can 
vary  from  month  to  month.  Thus,  while  the  presence  of  a  paid 
claim  in  one  month  confirms  a  person's  eligibility  for  that 
particular  month,  it  does  not  confirm  eligibility  for  any 
preceding  or  any  subsequent  month.  With  claims  data,  confirmation 
of  continuous  eligibility  over  a  period  of  time  requires  a  set  of 
claims    that    in   some   way   span    that    time   period. 

This  problem  was  resolved  in  the  following  way.  First,  the 
analytic  time  period  was  limited  to  one  month:  December 
1983.20  This  step  simplifies  greatly  the  task  of  establishing  a 
person's  eligibility.  Rather  than  confirming  continuous 
eligibility  over  a  several  month  period,  it  is  necessary  only  to 
establish  it  for  one.  While  this  approach  obviously  limits 
variation  in  the  key  utilization  measures,  it  offers  an  important 
advantage  in  connection  with  sample  size.  Expanding  the  time 
frame  for  the  analysis  beyond  one  month  diminishes  substantially 
the  number  of  observations  on  persons  with  confirmed  continuous 
eligibi lity . 

The  second  step  concerns  the  procedure  for  actually 
establishing    a    person's    eligibility     for    December.    Rather     than 
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limiting  the  observations  to  those  with  paid  claims  for  December, 
the  sample  was  expanded  to  include  those  using  Medicaid  services 
at  some  time  in  both  the  preceding  three  months  and  the  following 
three  months.  The  logic  behind  this  decision  is  that  utilization 
in  a  relatively  narrow  time  period  on  both  sides  of  December 
makes  it  highly  probable  that  eligibility  spanned  that  key 
month.  This  approach  to  defining  eligibility  offers  an  important 
advantage:  it  permits  the  sample  to  contain  observations  on  both 
users  and  nonusers  of  services  for  the  analysis  month,  thereby 
both  expanding  the  sample  size  and  increasing  the  variation  in 
the  dependent  variables. 

Observations  for  the  treatment  and  control  group  samples 
were  identified  by  inspecting  the  case  management  flag  included 
in  the  claims  records.  The  objective  was  to  limit  the  samples  to 
those  who  were  clearly  in  one  group  or  the  other  for  the  entire 
month  of  December.  Accordingly,  observations  for  the  treatment 
group  were  limited  to  persons  with  claims  records  indicating  case 
management  both  before  and  after  December,  Further,  for  those 
using  services  in  December,  the  claims  for  that  month  also  had  to 
indicate  case  management  for  the  observation  to  be  included  in 
the  treatment  group  sample.  Similar  criteria  were  employed  in 
identifying  observations  for  the  control  group:  only  those  with 
claims  records  indicating  no  case  management  both  before  and 
after  (and,  where  appropriate,  during)  December  were  selected. 

Creating  a  prior  use  measure  from  claims-level  data  required 
one  further  sample  selection  criterion.  A    prior  use  variable 
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reflects  utilization — in  this  instance,  total  paid  claims--for 
some  earlier,  well-defined  time  period.  For  this  study,  the  time 
period  selected  for  measuring  prior  use  is  six  months. 21  Of 
course,  measuring  prior  use  with  claims  data  again  raises  the 
problem  of  confirming  a  person's  eligibility  for  the  time  period 
in  question,  June  through  November  in  this  instance.  To  provide 
some  assurance  of  continuous  eligibility  over  the  prior  use 
period,  it  was  necessary  to  restrict  the  sample  to  observations 
on  persons  with  paid  claims  for  services  received  during  a  5 
month  time  frame  before  the  June-November  prior  use  time  period. 

The  foregoing  sample-selection  criteria  that  concentrate  on 
establishing  a  person's  continuous  eligibility  for  Medicaid  are 
summarized  in  Table  1.  While  these  criteria  fail  to  guarantee 
fully  that  only  those  Medicaid  enrollees  with  continuous 
eligibility  over  the  relevant  time  period  remain  in  the  analysis 
sample,  they  offer  reasonable  assurance  that  the  preponderance  of 
observations  satisfy  this  requirement.  Of  equal  importance,  they 
yield  an  analysis  sample  sufficiently  large  (n  =  7899)  to  permit 
tests  of  the  various  case-management  hypotheses,  even  though  the 
dependent  variables  pertain  to  a  very  short  time  period  and  thus 
exhibit  relatively  limited  variation. 

Table  2  provides  definitions  for  the  dependent  and 
independent  variables  developed  from  this  analysis  sample,  while 
Table  3  contains  the  corresponding  descriptive  statistics.  For 
the  most  part,  the  means  and  proportions  reported  in  Table  3 
refer  to  the  entire  analysis  sample  of  7899  observations.  The 


Table  1 

Utilization  Requirements  Imposed  by  Sample-Selection  Criteria 
Designed  to  Assure  Continuous  Eligibility  for  Medicaid  Services 

Utilization  Behavior 
during  the  Analysis  Month; 

Time  Period  User  Nonuser 


Are  paid  claims  required? 


December  1983 

(the  analysis  month) 


September-November  1983  Not  required, 

and  but  may  occur. 

January-March  1984 


June-November  1983  Not  required, 

(the  prior  use  time  but  may  occur. 

period) 


Five  months  preceding 
June  1983 


l.By  definition,  persons  in  this  category  have  no  paid  claims 
in  December. 


2. There  must  be  some  prior  use,  since  this  group  was  selected 
on  the  basis  of  having  paid  claims  during  September-November 
1983,  a  period  encompassed  by  the  prior  use  time  frame. 


Table  2 

Definitions  of  Dependent  and  Independent  Variables 

Employed  in  the  Multivariate  Analyses 

Dependent  Variables 

Primary  care  physician  services:  equals  1  if  Medicaid  enrollee 
had  at  least  one  paid  claim  for  such  services  for  December 
1983;  otherwise  0. 

Specialists'  services:  equals  1  if  Medicaid  enrollee  had  at 

least  one  paid  claim  for  such  services  for  December  1983; 
otherwise  0, 

Hospital  ER  or  OPD  services:  equals  1  if  Medicaid  enrollee  had  at 
least  one  paid  claim  for  such  services  for  December  1983; 
otherwise  0. 

Prescription  drugs:  equals  1  if  Medicaid  enrollee  had  at  least 
one  paid  claim  for  such  services  for  December  1983; 
otherwise  0. 

Clinic-based  physician  services:  equals  1  if  Medicaid  enrollee 
had  at  least  one  paid  claim  for  such  services  for  December 
1983;  otherwise  0. 

Hospital-based  physician  services:  equals  1  if  Medicaid  enrollee 
had  at  least  one  paid  claim  for  such  services  for  December 
1983;  otherwise  0. 

Primary  care  physician  expenditures:  total  dollar  amount  of  paid 
claims  for  a  Medicaid  enrollee's  use  of  this  service  during 
December  1983. 

Specialist  expenditures:  total  dollar  amount  of  paid  claims  for  a 
Medicaid  enrollee's  use  of  this  service  during  December 
1983. 

Hospital  ER  or  OPD  expenditures:  total  dollar  amount  of  paid 

claims  for  a  Medicaid  enrollee's  use  of  this  service  during 
December  1983. 

Prescription  drug  expenditures:  total  dollar  amount  of  paid 

claims  for  a  Medicaid  enrollee's  use  of  this  service  during 
December  1983. 

Clinic-based  physician  expenditures:  total  dollar  amount  of  paid 
claims  for  a  Medicaid  enrollee's  use  of  this  service  during 
December  1983. 
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Table  2  (continued) 


Hospital-based  physician  expenditures:  total  dollar  amount  of 
paid  claims  for  a  Medicaid  enrollee's  use  of  this  service 
during  December  1983. 

Independent  Variables 

Case  managed:  equals  1  if  enrollee  was  case  managed  during 
December,  otherwise  0. 

Prior  use:  total  dollar  amount  of  paid  claims  for  an  enrollee  for 
the  six  months  preceding  December. 

Age/Sex  Categories 

Child,  less  than  1  year:  equals  1  if  enrollee's  age  falls  into 
this  category;  otherwise  0. 

Child,  1  to  4  years:  equals  1  if  enrollee's  age  falls  into   this 
category;  otherwise  0. 

Child,  5  to  11  years:  equals  1  if  enrollee's  age  falls  into 
this  category;  otherwise  0. 

Female,  12  to  17  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Female,  18  to  24  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Female,  25  to  44  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Female,  45  to  64  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Male,  12  to  17  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Male,  18  to  24  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Male,  25  to  44  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 

Male,  45  to  64  years:  equals  1  if  enrollee's  sex  and  age  fall 
into  this  category;  otherwise  0. 
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Table  2  (continued) 


Race/Ethnicity 

Black:  equals  1  if  enrollee  is  black;  otherwise  0. 

Hispanic:  equals  1  if  enrollee  is  hispanic;  otherwise  0. 

White:  equals  1  if  enrollee  is  white;  otherwise  0. 

Other  race:  equals  1  if  enrollee's  race/ethnicity  is  other  than 
the  foregoing;  otherwise  0. 

County  of  Residence 

Salt  Lake:  equals  1  if  enrollee's  residence  is  this  county; 
otherwise  0. 

Weber:  equals  1  if  enrollee's  residence  is  this  county;  otherwise 
0. 

Utah:  equals  1  if  enrollee's  residence  is  this  county;  otherwise 
0. 

Davis:  equals  1  if  enrollee's  residence  is  this  county;  otherwise 
0. 


Table  3 
Selected  Descriptive  Statistics  for  the  Analysis  Sample 


Variable  Name 


Case       Not  Case 
Managed       Managed 


Dependent  Variables: 

Proportion  using  the  following 
Medicaid-covered  services  during 
December: 


Mean  or  Proportion 


Primary  care  physician 

0.172 

0.189 

0.148 

Specialist 

0.086 

0.093 

0.076 

Hospital  emergency  room  or 
outpatient  department 

0.081 

0.090 

0.068 

Prescription  drugs 

0.397 

0.455 

0.311 

Clinic -based  physician 
services 

0.057 

0.068 

0.041 

Hospital-based  physician 
services 

0.045 

0.051 

0.036 

Average  dollar  claims  for  users 
of  the  following  services: 

Primary  care  physician 

Specialist 

Hospital  emergency  room  or 
outpatient  department 

Prescription  drugs 

Clinic-based  physician 
services 

Hospital-based  physician 
services 

Independent  Variables: 

Proportion  case  managed 

Prior  use  (average  dollar 
claims  for  June -November  1983) 


$57.25 

$54.76 

$61.95 

$115.51 

$106.02 

$132.80 

$87.18 

$77.49 

$106.05 

$17.91 

$18.10 

$17.50 

$50.78 

$54.89 

$40.69 

$37.74 

$36.66 

$40.02 

$497.59     $516.77       $469.31 


Table  3  (continued) 


Case 

Not  Case 

Variable  Name 

All 

Managed 

Managed 

Mean  or  Proportion 

Age/Sex  Categories: 

Child,  less  than  1  year 

0.039 

0.025 

0.058 

Child,  1  to  4  years 

0.237 

0.235 

0.240 

Child,  5  to  11  years 

0.188 

0.185 

0.192 

Female,  12  to  17  years 

0.057 

0.052 

0.064 

Female,  18  to  24  years 

0.170 

0.181 

0.155 

Female,  25  to  44  years 

0.236 

0.257 

0.205 

Female,  45  to  64  years 

0.018 

0.018 

0.019 

Male,  12  to  17  years 

0.037 

0.031 

0.046 

Male,  18  to  24  years 

0.002 

0.002 

0.002 

Male,  25  to  44  years 

0.012 

0.010 

0.013 

Male,  45  to  64  years 

0.005 

0.005 

0.006 

Race/Ethnicity: 

Black 

0.031 

0.032 

0.029 

Hispanic 

0.122 

0.120 

0.124 

White 

0.823 

0.829 

0.813 

Other 

0.025 

0.019 

0.034 

County  of  Residence: 

Salt  Lake 

0.503 

0.498 

0.511 

Weber 

0.206 

0.238 

0.159 

Utah 

0.204 

0.207 

0.199 

Davis 

0.088 

0.058 

0.131 

Sample  Size 

7,899 

4,707 

3,192 

Source:   Authors'  tabulations. 
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measures  of  dollar  claims  for  selected  Medicaid  services 
represent  an  exception,  however.  They  apply  only  to  the  relevant 
subsets  of  observations  on  users  of  the  respective  services. 
Estimation  Issues 

This  study  investigates  the  causes  of  variation  in  two  types 
of  dependent  variables.  One  type  is  dichotomous,  indicating 
whether  or  not  a  person  uses  a  particular  health  service,  and 
applies  to  the  entire  analysis  sample.  The  other  type  is 
continuous,  indicating  the  amount  paid  for  services  received,  and 
pertains  to  users  of  services  only.  The  equations  for  explaining 
variation  in  the  dichotomous  dependent  variables  are  estimated 
with  the  probit  estimation  procedure  (Maddala,  1977).  The  other 
equations  for  explaining  variation  in  continuous  utilization 
measures  are  estimated  with  ordinary  least  squares. 

Both  the  continuous  expenditure  variables  and  the  prior  use 
variable  have  non-normal,  skewed  distributions  because  of 
outlying  observations.  For  example,  while  the  average  expenditure 
for  primary  care  physician  services  in  December  1983  was  $57,  the 
maximum  expenditure  was  $1293,  or  roughly  10  standard  deviations 
greater  than  the  mean.  To  correct  for  this  skewness,  all 
expenditure  variables  were  converted  to  logarithmic  form.  When 
measured  in  this  way,  the  difference  between  mean  and  maximum 
values  diminishes  substantially.  To  illustrate,  in  logarithms  the 
maximum  expenditure  for  primary  care  physician  services  exceeds 
the  mean  expenditure  by  only  3  standard  deviations. 
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IV.  FINDINGS 

The  basic  findings  concerning  the  impact  of  case  management 
are  presented  in  Table  4.  The  entries  in  this  table  show  the 
effect  of  case  management  on  enrollee  use  of  the  principal  types 
of  ambulatory  services,  after  adjusting  for  other  determinants  of 
ut i lization. 22  The  results  are  shown  as  percentages,  indicating 
the  predicted  use  by  a  case  managed  Medicaid  enrollee  relative  to 
the  predicted  use  by  an  enrollee  not  case  managed.  The  first 
column  of  estimates  apply  to  case  management's  impact  on  the 
probability  of  using  a  specific  service  during  a  month.  (The 
numbers  in  parentheses  are  absolute  valued  t_-stat ist ics. )  The 
second  column  indicates  how  the  level  of  use  among  users 
(measured  by  the  dollar  total  of  paid  claims  for  the  month)  are 
affected  by  case  management.  The  interaction  of  these  two 
foregoing  effects  is  shown  in  the  third  column  of  estimates. 23 
The  final  column  combines  all  of  these  effects  into  an  estimate 
of  case  management's  impact  on  expected  utilization  per 
enrollee. 24 

The  evidence  provided  in  Table  4  suggests  that  case 
management  affects  the  probability  of  use  differently  than  it 
affects  the  level  of  use  among  users.  Relative  to  the  control 
group  of  non-CM  enrollees,  case  managed  Medicaid  enrollees  are 
more  likely  to  use  services,  with  the  difference  being  highly 
significant  in  every  case  but  one  (specialists'  services).  In 
contrast,  the  level  of  use  among  users  typically  differs 
insignificantly  as  between  the  case  managed  and  the  controls  (the 
single  exception  is  hospital  ER/OPD  services).  In  connection  with 
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Estimated  Effects  of  Case  Management  on  Enrollee  Utilization, 
Adjusted  for  Other  Determinants! 

Impact  of  Case  Management  on; 

Expected 
Probability  Dollar 

Type  of  Use         Paid  Claims 

of  Per  Claims  Per 

Service Enrollee    +   Per  User   +   Interaction   =   Enrollee 

Primary  care    32.6%*         -2.4%  -0.8%  30.4% 

physician      (5.03)         (0.46) 

Specialist      12.9%         -0.1%  0  12.8% 

(1.44)         (0.01) 

Hospital        25.3%*        -29.4%*  -7.4%  -11.5% 

ER  or  OPD      (2.64)         (3.27) 

Prescription    41.8%*  0.4%  0.2%  42.4% 

Drugs         (11.10)        (0.14) 

Clinic-based    71.3%*         12.6%  9.0%  92.9% 

physician      (4.80)         (1.26) 

Hospital-       52.2%*         -9.7%  -5.0%  37.5% 

based  (3.18)         (1.10) 

phys  ician 

Source:  Authors'  calculations,  based  upon  multivariate  estimates 
derived  from  Utah  claims  records  for  Medicaid  recipients. 

*Stat ist ically  significant  at  the  99  percent  level  of 
confidence  for  a  two-tailed  test. 

1. Absolute  valued  t-statistics  are  in  parentheses. 
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the  overall  combined  effect  on  utilization  (the  last  column  in 
Table  4),  the  findings  indicate  that  case  management  raises 
utilization  for  five  of  the  six  services  investigated,  and  lowers 
it  for  one  (hospital  ER/OPD)  . 

Does  this  evidence  support  acceptance  or  rejection  of  the 
hypotheses  concerning  the  impact  of  case  management?  The  answer 
is  mixed:  some  receive  support  from  the  findings,  while  others  do 
not.  The  implications  of  the  results  for  each  hypothesis  will  be 
considered  in  turn. 

Primary  care  physician  services.  Case  management  was 
expected  to  increase  recipient  use  of  primary  care  providers.  The 
evidence  suggests  that  this  objective  was  achieved.  Case 
management  raises  the  likelihood  of  contact  during  a  month  by  33 
percent,  a  highly  significant  impact.  However,  it  does  not  seem 
to  alter  the  level  of  use  among  users:  paid  claims  per  month 
(adjusted  for  other  factors)  are  essentially  the  same  for  both 
groups . 

Specialists'  services.  An  important  goal  of  Utah's  case 
management  program  is  reducing  the  use  of  specialists' 
services.  The  estimates  in  Table  4  imply  that  the  program  has 
fallen  short  with  respect  to  this  objective.  The  predicted 
likelihood  of  seeing  a  specialist  is  actually  greater  among  the 
case  managed  group,  although'  the  difference  does  not  attain 
statistical  significance.  Moreover,  no  difference  in  the  level  of 
use  among  users  in  the  treatment  and  control  groups  was  detected. 
While  the  evidence  does  not  support  the  inference  that  case 
management  raises  the  use  of  specialists'  services,  it  clearly 
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supports  rejection  of  the  notion  that  case  management  lowers  the 
use  of  specialists. 

Hospital  ER/OPD  services.  In  part,  case  management  was 
designed  to  lower  the  nonemergency  use  of  hospital  ERs  and 
OPDs.  The  evidence  indicates  that,  on  balance,  case  management 
attained  modest  savings  in  the  use  of  ER/OPD  services. 25  Compared 
to  the  control  group,  expected  dollar  claims  for  case  managed 
enrollees  was  11.5  percent  lower.  Notably,  this  aggregate  savings 
was  achieved  through  a  combination  of  1)  heightened  likelihood  of 
using  ER/OPD  services  during  a  month  (25  percent  greater  among 
the  case  managed) ,  but  2)  reduced  level  of  use  among  the  users  of 
these  services  (29  percent  less  among  the  case  managed) . 

Prescription  drugs.  Reducing  the  use  of  prescription  drugs 
was  another  objective  of  the  case  management  program.  The 
findings  in  Table  4  indicate  clearly  that  this  objective  was  not 
achieved.  To  the  contrary,  prescription  drug  use  appears  to  have 
risen  by  statistically  significant  amounts  under  case 
management.  Compared  to  the  controls,  case  managed  enrollees  are 
42  percent  more  likely  to  use  prescription  drug  services  during  a 
month.  Further,  among  those  obtaining  prescription  drugs,  the 
level  of  use  (as  measured  by  paid  claims)  simply  seems  unaffected 
by  case  management.  The  combined  effect  results  in  a  substantial 
increase  (of  about  42  percent)  in  expected  dollar  claims  per  case 
managed  enrollee. 

Cost  containment.  Lowering  overall  costs  for  the  Medicaid 
program  was  probably  the  principal  motivation  behind  the  case 
management  idea.  Indeed,  early  estimates  by  the  State  of  Utah 
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suggested  substantial  savings  from  case  management.  However,  the 
evidence  presented  in  Table  4  does  not  confirm  the  notion  that 
case  management  ultimately  saves  money.  In  connection  with  five 
of  the  six  services  investigated,  case  management  seems  to  raise 
the  cost  of  providing  care  for  Medicaid  recipients.  A  weighted 
average26  of  the  predicted  effects  for  all  of  the  services 
provides  an  image  of  the  overall  cost  implications  of  case 
management.  Across  all  six  services,  case  management  raises 
expected  dollar  claims  per  Medicaid  enrollee  by  25  percent,  after 
adjusting  for  other  factors. 

V.  DISCUSSION 

A  principal  federal  objective  underlying  the  OBRA  Medicaid 
changes  was  to  offer  the  states  greater  flexibility  to  experiment 
with  new  programmatic  approaches  that  had  a  potential  for  shared 
federal-state  savings.  Specifically,  the  2175  freedom  of  choice 
waivers  promised  to  be  a  cost-effective  way  to  reduce  the  use  of 
high  cost  ser v ices--f or  example,  outpatient  department  and 
specialists'  care--while  assuring  adequate  access  to  office- 
based  primary  care  services.  Utah's  case  management  program 
promised  to  seek  these  objectives.  Moreover,  it  sought  to  achieve 
increased  access  to  and  continuity  of  primary  care,  since 
physician  participation  in  Medicaid  was  viewed  as  too  low.  To 
meet  the  combined  federal  and  state  objectives,  the  cost  of 
increased  access  to  primary  care  physicians  would  have  to  be  more 
than  offset  by  the  savings  from  reduced  use  of  the  OPD/ER, 
specialists'  services,  and  prescription  drugs. 


31 
What  new  program  procedures  or  economic  incentives  were 
employed  by  Utah  in  seeking  these  objectives?  Two  changes  might 
have  increased  primary  care  use  and  spending.  Upon  their  initial 
eligibility  or  their  redetermination  hearing,  the  program  helped 
Medicaid  eligibles  choose  a  case-manager  known  to  accept  Medicaid 
reimbursement.  The  association  with  this  provider  was  reinforced 
by  printing  the  physician's  name  on  each  subsequent  Medicaid 
care.  For  primary  care  providers  considering  Medicaid 
participation,  the  case  manager  role  seemingly  offered  a  more 
continuous  and,  therefore,  larger  stream  of  revenue  from  each 
Medicaid  patient  seen.  This  might  lead  to  increased 
participation,  either  through  a  greater  number  of  participating 
physicians  or  through  increased  Medicaid  patient  loads  among 
previous  participants. 

Corresponding  procedures  and  incentives  that  might  have 
reduced  the  use  of  high  cost  services  were  not  employed  by  Utah 
during  the  period  of  this  evaluation,  however,.  Although  referral 
forms  were  used  to  signify  that  a  case  manager  had  given  prior 
authorization  for  some  specialized  service,  procedures  had  not 
been  implemented  to  deny  reimbursement  for  providers'  bills  that 
were  unaccompanied  by  a  referral  form.  Therefore,  there  was  no 
economic  incentive  for  specialists  or  OPDs  to  deny  care  to 
patients  who  self-referred.  Moreover,  Utah  offered  Medicaid  case 
managers  no  direct  financial  incentives  to  alter  their  referral 
patterns.  The  only  economic  incentive  for  providers  to  change 
their  behavior  in  a  way  that  would  lead  to  program  savings  was 
extremely  indirect.  The  State  proposed  to  share  any  aggregate 
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savings  achieved  by  case  management  with  those  providers 
participating  in  the  case  management  program.  Due  to  the  "free 
rider  problem,"  this  approach  probably  had  little  or  no  effect  on 
individual  providers'  behavior:  since  each  provider  presumably 
recognizes  that  his  or  her  Medicaid  treatment  and  referral 
decisions  will  have  a  negligible  effect  on  total  program  savings 
or  costs,  there  is  virtually  no  individual  incentive  to  conserve 
on  Medicaid  resources.  Obviously,  if  most  providers  respond  in 
this  fashion,  as  they  almost  surely  will,  few  aggregate  savings 
can  be  expected. 

The  quantitative  findings  of  this  evaluation  support  the 
above  interpretation  of  the  behavioral  incentives  created  by  the 
Utah  case  management  program.  Consistent  with  one  of  its  key 
objectives,  the  program  stimulated  access  to  primary  care 
physicians,  with  spending  rising  about  30  percent  per  enrollee. 
Some  of  the  increased  use  may  be  the  result  of  shifting  patients 
to  office-based  physicians  from  more  expensive  sites--especially 
OPDs  and  ERs,  where  spending  fell  12  percent.  The  increase  also 
may  have  resulted  from  patients  seeking  additional  primary  care 
that  would  not  otherwise  have  been  provided.  In  the  latter  case 
it  is  reasonable  to  assume  that  increased  access  will  lead  to  the 
detection  of  otherwise  untreated  conditions,  resulting  in 
additional  referrals  to  specialists  and  additional  drug 
prescr  ipt ions . 

Complementarity  between  primary  care  services  and  other 
services  would  appear  to  make  it  very  difficult  to  achieve 
simultaneously  the  cost  savings  objective  and  the  access 
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objective.  The  findings  presented  here  suggest  that  the  Utah 
Medicaid  program  achieved  its  objective  of  enhanced  access  to 
primary  care  physicians.  Moreover,  the  mix  of  services  was 
shifted  toward  office-based  care,  away  from  OPD/ER  care.  However, 
this  success  in  the  access  dimension  was  achieved  at  the  expense 
of  increased  program  costs.  Across  the  six  services  investigated 
in  this  study,  Utah's  case  management  program  was  found  to  raise 
expected  dollar  claims  by  25  percent  per  Medicaid  enrollee,  after 
adjusting  for  other  factors.  Rather  than  helping  to  contain 
Medicaid  costs,  Utah'  case  management  program  apparently  inflates 
spending  on  balance. 

Over  the  longer  run,  the  actual  added  cost  might  differ  from 
this  estimate  for  several  reasons.  The  present  evaluation  used 
data  drawn  from  the  program  when  roughly  half  the  enrollee 
population  was  ca.se-managed .  Some  of  the  higher  utilization 
observed  in  the  case-managed  population  could  be  transitory — both 
as  a  result  of  the  newly  case-managed  population  trying  out  their 
new  primary  care  physicians,  and  as  a  result  of  treating  pent-up 
health  needs  of  a  relatively  under-served  population.  On  the 
other  hand,  strong  promotion  of  the  "gatekeeper"  role  to 
recipients,  who  would  otherwise  "doctor-shop"  and  self-refer  to 
specialists,  might  bring  temporary  restraint  that  over  the  longer 
run  would  give  way  to  old  habi ts--especia lly  when  it  became  clear 
that  providers  have  no  incentive  to  deny  care  to  patients  without 
a  referral  form.  Regardless  of  the  exact  magnitude  of  increased 
cost  under  this  particular  case-management  program,  it  seems 
likely  that  to  achieve  overall  savings  a  program  must  provide  for 
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strong  economic  incentives  for  primary  care  providers  to  reduce 
total  spending  on  the  enrolled  population.  Perhaps  in  a  later 
stage  of  its  development  the  Utah  program  will  employ  such 
methods  in  order  to  achieve  federal  objectives  under  it  freedom 
of  choice  waiver. 
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ENDNOTES 

^Utah  was  selected  for  two  reasons.  First,  its  CM  program 
was  implemented  in  a  way  that  facilitated  an  empirical 
investigation  of  the  program's  effectiveness.  Secondly,  the  State 
of   Utah   provided    the   data    necessary    for    such   an   evaluation. 

^This  requirement  applies  to  noninstitutionalized  Medicaid 
enrollees  who  gained  access  to  Medicaid  benefits  through  their 
eligibility  for  benefits  under  any  of  the  following  three 
programs:  1)  Aid  to  Families  with  Dependent  Children;  2)  Care  for 
Children  (a  program  for  crippled  children);  and  3)  Old  Age 
Assistance.  Exceptions  to  this  rule  include  those  Medicaid 
enrollees  in  protective  custody  and  "lock-in"  recipients  (i.e., 
high  users  already  assigned  to  a  specific  physician  and 
pharmacy).  Further,  General  Assistance  recipients  were  not 
affected  by  these  proposed  restrictions.  Among  those  eligible  for 
this  program  statewide,  90  percent  are  AFDC  recipients,  8  percent 
are  OAA  beneficiaries,  and  the  remaining  2  percent  are 
noninstitutionalized  crippled  children.  {Source:  Application  for 
renewal    of    the   waiver,    1/23/84.) 

^The  HMO  option  was  not  available  in  Utah  County;  enrollees 
had    to    select    a   case  manager. 
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^This  discussion  is  based  upon  the  original  waiver  request, 
which  took  the  form  of  a  letter  from  Governor  Scott  M.  Matheson 
to  Richard  Schweiker,  Secretary  of  Health  and  Human  Services, 
dated  November  2,    1981. 

^These  may  be  either  the  initial  eligibility  determination 
proceedings  or  the  annual  review  of  an  enrollee's  continuing 
eligibility  for  Medicaid  and  other  welfare  benefits. 

^Fruend  (p.  32)  points  out  that  "if  a  recipient  does  not 
select  a  physician  at  the  time  of  eligibility  determination,  [she 
or]  he  will  be  called  by  a  health  plan  representative  and 
encouraged  to  return  to  choose  a  primary  care  provider.  If  [she 
or]  he  does  not  return,  however,  physicians  are  not  automatically 
assigned."  However,  Bell  (1986)  suggests  that  this  type  of 
evasion  would  work  for  only  so  long;  eventually,  such  persons 
would  be  referred  to  the  state's  lock-in  program  for  mandatory 
assignment  by  the  state  to  a  particular  provider. 

"^This  estimate  is  based  upon  the  authors'  tabulations  of 
data  obtained  from  the  Utah  Medicaid  program. 

^New  Medicaid  cards  are  mailed  to  enrollees  each 
month.  Printing  of  the  case  manager's  name  on  each  monthly  card 
is  now  automated.  However,  in  the  early  stages  of  the  CHCD 
program,  this  information  apparently  was  not  being  printed  on  the 
mailed  cards  (Fruend,  p.  33) . 
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^Unnecessary  use  of  specialists'  services  was  viewed  as  a 

serious  and  expensive  problem.  Accordingly,  under  the  CHCD 

program,  referrals  to  specialists  required  written  authorization 

from  the  case  manager.  To  facilitate  monitoring  of  referrals  to 

specialists,  a  copy  of  these  authorizations  had  to  be  forwarded 

to  the  Medicaid  program.  Referrals  for  other  services  (e.g.,  lab 

tests.  X-rays)  did  not  require  special  written  authorization  from 

the  case  manager.  However,  all  claims  for  referral  services 

needed  the  case  manager's  Medicaid  ID  number,  so  unauthorized 

care  would  go  unreimbursed,  at  least  in  principle. 

l^in  the  waiver  application,  state  officials  announced  plans 
to  contract  with  two  physician  consultants  to  monitor  the 
performance  of  case  managers.  Case  managers  practicing 
"preventive"  rather  than  "crisis"  medicine  would  be  designated  as 
preferred  physicians  for  the  CHCD  program  (Neuschler).  However, 
at  least  in  the  early  months  of  implementation,  no  list  of  such 
"preferred  physicians"  was  available  for  helping  enrollees  select 
a  case  manager  (Bell,  p.  40). 

■'■•^For  evenings  and  weekends,  this  access  requirement  implies 
nothing  more  than  providing  recipients  with  the  phone  number  of 
an  answering  service. 

^^These  preliminary  findings  used  in  support  of  the  state's 
application  to  renew  its  f reedom-of-choice  waiver  (dated  1/23/84). 
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■'■^In  fact,  the  preliminary  state  study  indicated  that  CM 
management  may  have  reduced  doctor  shopping  substantially:  CM  was 
credited  with  causing  the  average  number  of  different  physicians 
seen  by  case-managed  Medicaid  clients  to  fall  by  25 
percent.     (Source:    renewal    application,    dated    1/23/84) 

l^The  source  is  the  renewal  application,  dated  1/23/84.  For 
a  discussion  and  critique  of  the  state's  assessment  see  the 
appendices . 

■^^Another  feasible  cross-sectional  research  design  uses 
observations  on  Medicaid  clients  living  in  counties  not  yet 
included  in  the  CM  program  to  establish  the  control  group.  A 
potential  problem  with  this  design  arises  from  the  possibility 
that  observed  differences  between  the  treatment  and  control 
groups  stem,  not  from  case  management,  but  from  other  factors 
correlated   with    county   of    residence. 

A  "before-after"  (or  time  series)  research  design  is  also 
feasible  with  the  data  employed  in  this  study.  Such  a  design 
would  entail  comparisons  of  utilization  or  expenditure  rates  for 
Medicaid  clients  before  and  after  enrollment  in  case 
management.  In  effect,  the  case  managed  population  serves  as  its 
own  control.  The  major  drawback  to  this  design  is  its  underlying 
assumption  that  other  factors  capable  of  influencing  recipient 
behavior  remain  constant  over  the  relevant  time  period,  so  that 
any  observed  change  in  behavior  is  attributable  to  case 
management.  The  validity  of  this  assumption  is  almost  always 
oroblemat  ic . 
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^^Health  status  measures  would  also  help  control  for  this 

selection  effect.  However,  aside  from  prior  use  information,  the 

data  reveal  nothing  about  health  status. 

^"^U  t  i  1  i  zat  ion  models  often  contain  additional  variables  to 
control  for  such  factors  as  education,  health  status,  and  family 
size  or  structure.  However,  the  data  employed  in  this  study  limit 
the  control  variables  to  those  described  in  the  text. 

l^For  details,  see  Appendix  B. 

^^See  Appendix  B  for  additional  discussion  of  the  original 
data  and  description  of  the  construction  of  the  analysis  database. 

^Ooecember  was  selected  in  order  to  assure  availability  of 
sufficient  data  from  earlier  months  for  the  purpose  of  creating 
the  prior  use  variables. 

21a  nine-month  prior  use  variable  was  also  created.  However, 
it  produces  results  qualitatively  identical  to  those  obtained 
with  the  six-month  prior  use  variable.  The  six-month  measure  is 
thus  preferred,  since  it  involves  a  less  restrictive  sample 
selection  criterion  and  consequently  yields  a  larger  sample. 


determinants  of  utilization  equal  their  mean  values. 

2-^The  interaction  percentage  is  calculated  by  multiplying 
the  two  individual  percentage  estimates  together.  For  instance, 
(32.6%  X  -2.4%)  =  -0.78%,  or  -0.8%  after  rounding. 
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''^By  definition,  expected  use  per  enrollee  (EU)  equals  the 
product  of  1)  the  probability  of  using  a  service  (P)  and  2)  the 
predicted  level  of  use  among  users  (U);  that  is, 

EU  =  P  X  U. 
From  this  relationship,  it  follows  that: 

%chg  EU  =  %chg  P  +  %chg  U  +  interaction  term, 
where  %chg  indicates  percentage  change  in  a  particular  variable, 
and  the  interaction  term  is  the  product  of  %chg  P  and  %chg  U. 

25The  analysis  does  not  distinguish  between  emergency  and 
nonemergency  use  of  ERs  and  OPDs.  However,  unless  emergency 
conditions  and,  thus,  use  occurred  more  frequently  among  one  of 
the  two  groups,  the  predictions  will  show  differences  pertaining 
to  nonemergency  use.  The  large  sample  sizes  and  the  socioeconomic 
similarities  between  the  treatment  and  control  groups  offer  no 
reason  for  concern'  about  either  random  or  systematic  differences 
in  emergency  conditions  between  the  treatment  and  the  control 
groups . 

2°The  weights  reflect  relative  program  expenditures  for  the 

six  services.  The  specific  values  for  the  weights  are  -256   for 

primary  physician;  .258  for  specialist;  .183  for  hospital  ER/OPD; 

.184  for  prescription  drugs;  .075  for  clinic-based  physician;  and 

.044  for  hospital-based  physician. 


Appendix  A 


Discussion  and  Critique  of  Utah's  Evaluation  of 

the  Case  Management  Program  for  Purposes  of 

Securing  the  Second  Waiver 
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As  part  of  the  application  for  renewal  of  their  "freedcT  of 
choice"  waiver,  the  State  of  Utah  provided  DHHS  wi-h  an 
evaluation  of  the  cost  effectiveness  of  the  CHCD  program  during 
its  first  year^ly  Based  upon  their  calculations,  the  State  of  Utah 
claimed  savings  from  the  case  management  component  of  CHCD  equal 
to  S37  per  Medicaid  client,  for  total  savings  of  31.1  million  per 
year.  The  savings  from  the  HMO  component  of  CHCD  was  estimated  to 
equal  another  $1.1  million  per  year.  Overall,  the  Utah  evaluation 
claimed  a  savings  of  $5.40  for  every  $1.00  spent  on  the  CHCD 
program._2y 

This  appendix  contains  a  critique  of  the  Utah 
cost-effectiveness  evaluation,  especially  that  part  dealing  with 
the  CM  program.  As  will  be  seen,  the  Utah  evaluation  of  CM 
suffers  from  two  basic  problems.  The  first,  and  less  serious,  of 
the  two  problems  stems  from  simple  errors  in  data 
manipulation.  Correction  of  these  errors  nearly  doubles  the 
estimated  cost  savings  from  the  CM  portion  of  CHCD.  The  second 
and  more  serious  problem  is  methodological  in  nature.  The 
approach  Utah  employed  in  estimating  cost  savings  from  CM  is 
flawed  logically.  Correcting  their  methodology,  without  actually 
altering  their  approach  fundamentally,  results  in  a  finding 
consistent  with  the  one  reported  in  the  text  of  this  report:  that 
is,  CM  appears  to  raise  costs,  not  lower  them.  The  assessment 
concludes  with  a  comparison  between  the  corrected  and  revised 
Utah  estimates  of  the  cost  effects  of  CM  and  the  cost  effects 
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implied    by    the    findings    reported    in    this    study.    A    summary    of    the 
various    cost    estimates    appears    in    Table    A-1. 
Errors    in  Data    Manipulation 

The  estimate  of  a  $37  savings  per  client  reported  by  Utah 
was  based,  in  part,  on  an  estimate  that  CM  actually  caused  an 
anomalous  (and  unexplained)  $41  per  client  increase  in  lab  and 
x-ray  costs  (see  Table  A-1).  The  estimate  of  $41  per  client  is 
wrong  because  of  three  addition  errors  in  the  Utah 
evaluation.  The  Utah  evaluation  reports  that  9,953  people  used 
lab  or  x-ray  services  in  FY  1982;  the  correct  total--based  upon 
the  numbers  provided  in  the  evaluation--is  10,953.  Similarly,  it 
reports  6,687  using  those  services  in  FY  1983;  the  correct  total 
is  9,687.  Finally,  the  evaluation  indicates  that  the  total 
payments  for  lab  and  x-ray  services  in  FY  1983  was  $718,109;  the 
correct  total  is  $768,109.  Recalculating  the  cost  impacts,  usiag 
the  Utah  methodology  with  these  correct  totals,  yields  an 
estimate  of  a  cost  increase  per  client  for  lab  and  x-ray  services 
of  only  $19.  Based  upon  the  Utah  methodology,  this  would  have 
produced  an  overall  cost  savings  from  CM  equal  to  $59  per  client. 
The  second  row  of  estimates  in  Table  A-1  reflects  theses 
corrections . 

A  second  problem  with  the  Utah  evaluation  also  arises  in 
connection  with  the  estimates  of  lab  and  x-ray  use.  The 
evaluation  claims  that  the  number  of  Medicaid  clients  in  Weber 
County  using  lab  or  x-ray  services  fell  by  68  percent  (from  2223 
to    721)    as    a    result    of    CM.    Yet,    no    such    change    occurred    in    the 


Table  A-1 

Comparison  of  Alternative  Estimates  of  the  Savings  Implications 

of  Utah's  Case  Management  Program 

Overall 
Lab  Savings 

Source  of       Inpatient     Physi-                  &  Per 

Estimate Hospital cian Drugs    OPD    X-ray    Clinic Person 


Based  on  Savings  per  Service  User 

Original 

Utah  +  $62        +  $  2       $  0   +  $22   -  $41      -  $  8   =   +  $37 

Estimates 

Corrected 

Utah  +  $62        +  $  2       $  0   +  $22   -  $19      -  $  8   =   +  $59 

Estimates 


Based  on  Savings  per  Medicaid  Retipientl 

Utah  Estimates 

Recalculated 

on   a   Per  -$30  -$3  +$1+$13-$1  +$5= 


Recipient  Basis 


Long/Settle 

Estimates  na       -  $11     -  $10   +  $  2 

Recalculated 

on  a  Per 

Recipient  Basis 


1. "Recipient"  in  this  context  refers  to  a  recipient  of  any  Medicaid  service. 
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three  neighboring  counties.  In  Davis  County,  the  number  using 
these  services  fell,  but  by  only  5  percent.  In  Salt  Lake  and  Utah 
Counties,  the  number  of  Medicaid  clients  using  these  services 
rose,  by  2  percent  and  8  percent  respectively.  Moreover,  no 
similar  drop  in  the  use  in  other  services  was  reported  for  Weber 
County.  In  fact,  the  number  of  clients  in  Weber  County  seeing 
physicians  or  visiting  an  OPD  —  services  that  are  almost  surely 
complementary  with  lab  and  x-ray  use — rose  by  17  and  2  percent 
respectively  between  FY  1982  and  FY  1983. 

These  facts  suggest  that  the  number  of  users  of  lab  and 
x-ray  services  in  Weber  County  is  simply  misreported  in  the  Utah 
evaluation.  The  suggestion,  appearing  in  the  Utah  evaluation, 
that  the  drop  in  users  of  lab  and  x-ray  services  reflects  case 
managers  "...doing  a  better  job  of  managing  the  clients  health" 
is  completely  implausible,  in  light  of  the  foregoing  evidence. 
Rather,  the  reported  numbers  pertaining  to  the  number  of  lab  and 
x-ray  users  in  Weber  County  are  much  more  likely  to  reflect 
nothing  more  than  an  error  in  the  data  employed  in  the  Utah 
eva luat  ion . 

The  Utah  evaluation  does  not  contain  enough  information  to 
provide  an  obvious  basis  for  deriving  an  alternative  reasonable 
estimate  of  the  number  of  users  of  lab  and  x-ray  services  in 
Weber  County.  In  any  event,  the  significance  of  this  flaw  in  the 
Utah  evaluation  will  be  seen  as  minor  relative  to  the 
significance  of  the  methodological  problems  discussed  below,  so 
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efforts    to    correct    this    particular    data    problem   are,    in    the    end, 
simply   not   worthwhile.^/ 
Methodological    Issues 

The  main  objective  of  the  Utah  CM  evaluation  was  to  develop 
an  estimate  of  the  impact  of  CM  on  the  cost  per  Medicaid 
recipient.  This  per  recipient  cost  estimate  could  then  be 
combined  with  an  estimate  of  the  total  number  of  recipients  to 
compute  an  estimate  of  the  total  dollar  impact  of  case 
management.  While  the  Utah  evaluation  claims  to  have  estimated 
costs  on  a  per  recipient  basis,  the  estimates  reported  in  the 
evaluation   are,    in    fact,    something    else   entirely. 

The  Utah  methodology  employed  the  following 
procedure.  First,  it  develops  a  county-by -county  estimate  of  the 
cost  effects  of  CM  on  a  per  user  basis.  These  county  estimates 
are  then  combined,  in  a  weighted  average,  to  provide  an  overall 
estimate  of  the  average  savings  (or  loss)  per  user  for  that 
service.  To  illustrate,  the  estimates  of  the  effect  of  CM  on 
inpatient  hospital  costs  reveal  an  average  savings  of  $62  (see 
Table  A-1 ;  either  row  1  or  2);  this  estimate  applies  to  users  of 
inpatient  services  only,  not  to  all  enrollees.  Similarly,  the 
estimate  for  physician  services  applies  to  users  of  those 
services,    not    to   all    recipients. 

The  second  step  in  the  Utah  methodology  is  to  add--with  no 
special  we i gh t i ng --a  1 1  of  the  estimates  for  each  of  the 
individual  services,  computed  on  a  per  user  basis,  to  derive  an 
estimate    of    overall    cost    impacts    per    client.     It    is    at    this    point 
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that  the  methodological  error  occurs.  Adding  the  costs-per-user 
(as  is  done,  for  example,  in  rows  1  and  2  in  Table  A-1)  clearly 
does  not  yield  an  overall  cost  estimate  that  applies  to  the 
entire  recipient  population,  since  the  number  of  users  for  any 
one  service  is  usually  a  fraction — sometimes  a  small  fraction--of 
the  total  recipient  population.  In  fact,  since  the  number  of 
users  varies  across  the  services,  it  is  not  clear  to  which  group, 
if    any,    the   overall    Utah    cost   estimates    apply. 

An  illustration  may  help  fix  ideas.  Consider  a  Medicaid 
program  serving  30,000  recipients  (approximately  the  number  in 
the  four-county  Utah  area  under  consideration  here) .  Assume  that 
during  a  typical  year  20  percent,  or  6,000,  use  inpatient 
hospital  services  while  90  percent,  or  27,000,  use  physician 
services.  (For  purposes  of  this  illustration,  ignore  all  other 
services.)  Next,  imagine  that  case  management  is  found  to  reduce 
inpatient  hospital  costs  by  $62  per  user  (that  is,  for  the  6,000 
users  of  inpatient  services) ,  while  lowering  the  cost  of 
physician  services  by  $2  per  user  (that  is,  for  the 
27,000).  (These  cost  savings  are  the  ones  actually  estimated  by 
Utah;  see  Table  A-1.)  The  Utah  methodology  would  simply  add  these 
two  cost  saving  together  to  get  $64  as  the  savings  per 
recipient.  Applying  this  estimate  to  the  entire  recipient 
population  yields  an  aggregate  savings  of  $1.92  million  ($64  x 
30  ,  000    recipients)  . 

This  estimate  is  clearly  inappropriate.  Most  recipients  do 
not    use    inpatient    hospital    services,    so    the    $62    savings    does    not 
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apply  to  them.  Similarly,  for  those  not  using  physician  services, 
case  management  will  save  nothing. 

An  appropriate  way  to  estimate  total  savings  (and  still 
retain  the  spirit  of  the  Utah  approach)  is  to  compute  the  savings 
on  the  basis  of  the  total  recipient  population.  Thus,  while  the 
estimated  savings  per  user  of  inpatient  hospital  services  is  $62, 
the  expected  savings  per  recipient  is  $12.40;  that  is,  the 
savings  per  user  times  the  probability  that  any  given  recipient 
of  Medicaid  services  will  use  inpatient  services  (or  $62  x  0.2  = 
$12.40).  By  the  same  token,  the  appropriate  estimate  for  the  per 
recipient  savings  on  physician  services  is  $1.80  (=  $2.00  x  0.9), 
rather  than  $2.  These  two  estimates  can  properly  be  added 
together,  since  they  apply  to  the  same  population.  Thus,  the 
correct  estimated  cost  savings  per  recipient  would  be  $14.20  (= 
$12.40  +  $1.80),  rather  than  the  $64  implied  by  the  Utah 
methodology. 

When  this  appropriate  methodology  is  applied  to  the  data 
provided  in  the  Utah  evaluation,  the  results  are  indeed 
dramatic.  Recall  that  the  (corrected)  Utah  estimate  was  that  CM 
saved  $59  per  recipient,  for  a  total  of  about  $1.76  million  per 
year.  Using  the  proper  methodology  for  computing  per  recipient 
costs  (and  accepting  all  remaining  assumptions  underlying  the 
Utah  approach)  yields  a  finding  that  CM  actually  raises  costs  by 
$15  per  recipient  (see  Table  A-1,  row  3),  or  by  a  total  of  about 
$446,000  per  year. 
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While  there  are  other  aspects  of  the  Utah  evaluation  that 
could  be  criticized,  they  are  less  important  than  the  foregoing 
methodological  problem  .^4/1  n  light  of  the  significance  of  this 
basic  error  in  the  Utah  evaluation,  it  seems  that  little  would  be 
accomplished  by  going  any  further  in  this  assessment  of  the  Utah 
evaluation. 
A  Partial  Comparison  of  Estimated  Impacts  of  CM 

A  limited  comparison  between  the  findings  of  the  Utah 
evaluation  and  those  reported  in  the  present  study  is 
possible.  The  comparison  is  a  limited  one  because  the  service 
categories  employed  in  the  Utah  evaluation  do  not  match  perfectly 
those  used  in  this  study.  In  particular,  it  is  feasible  to 
compare  estimated  cost  savings  for  the  following  services 
only:  1)  physician  services  (primary  care  physician  and 
specialist  services  combined);  2)  drugs;  and  3)  OPD  services. 

The  cost  estimates  for  the  present  study  are  derived  from 
the  estimates  reported  in  Table  4,  along  with  some  of  the 
aggregate  expenditure  data  provided  in  the  Utah  evaluation.  An 
illustration  will  help  describe  the  method  for  deriving  these 
cost  estimates.  Consider  the  category  of  prescription 
drugs.  Table  4  shows  that  case  management  raises  expected  dollar 
claims  per  case-managed  enrollee  by  42.4  percent;  that  is,  other 
things  equal,  if  the  average  expenditure  on  a  nonCM  client  is  $X 
per  year,  then  the  average  expenditure  on  a  CM  client  would  be 
$1.424X.  The  Utah  evaluation  indicates  that  the  actual  average 
expenditure  for  drugs  for  CM  and  nonCM  clients  combined  was  SlOO 


in  FY  1983.^In  other  words,  the  overall  figure  of  $100  is  a 
weighted  average  of  the  per  client  expenditures  on  the  CM  and 
nonCM  subpopula t ions ,  where  the  weights  reflect  the  relative 
sizes  of  the  two  groups. 

In  equation  form,  this  relationship  can  be  expressed  as: 
$100  =  WcTr.($1.424X)  +  wn($X), 
where  Wcm  indicates  the  proportion  of  the  Medicaid  population 
that  was  case  managed  in  FY  1983;  Wn  indicates  the  proportion 
that  was  not  case  managed  (of  course,  the  two  weights  add  to  1); 
$X  is  the  average  drug  expenditures  for  the  nonCM  group;  and 
$1.424X  is  the  average  drug  expenditure  for  the  CM  group. 

With  the  available  data,  it  is  not  possible  to  know  with 
certainty  the  actual  values  for  the  weights.  1 1^  is  clear, 
however,  that  Wcm  is  less  than  0.5.  Utah's  fiscal  year  ends  on 
June  30.  Thus,  FY  1983  covers  the  period  from  July  1,  1982 
through  June  30,  1983.  By  December  1983,  enrollment  in  CM  was 
only  50  percent  of  the  eligible  population  (see  the  text  of  the 
report) .  Accordingly,  the  enrollment  percentage  for  FY  1983  must 
have  been  substantially  less  than  50  percent.  This  hypothesis 
receives  further  support  from  the  fact  that  CM  was  in  operation 
for  only  part  of  FY  1983,  so  for  some  of  the  fiscal  year  no  one 
was  covered  by  CM.  Case  management  began  in  August  1982  in  Salt 
Lake  County,  October  1982  in  Davis  and  Weber  Counties,  and 
January  1983  in  Utah  County.  For  purposes  of  developing  cost 
estimates  comparable  to  those  provided  in  the  Utah  evaluation,  it 
is  assumed  that  an  average  of  25  percent  of  the  eligible 
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population  in  these  four  counties  was  covered  by  CM  during  FY 
1983. 

Using  weights  of  0.25  for  the  CM  group  and  0.75  for  the 
nonCM  group  yields  an  estimate  of  $90.42  in  drug  expenditures  per 
nonCM  client  and  $128.75  {=  1.424  x  $90.42)  per  CM  client,  for  a 
dollar  cost  differential  per  CM  client  of  $38.33.  This  estimate 
translates  into  an  aggregate  cost  of  about  $285,000,  based  upon 
the  Utah  statement  that  the  total  number  eligible  for  CM  during 
FY  1983  was  29,760  [$285,000  =  ($38.33)  x  (.25)  x 
(29,760)].  Spreading  this  cost  increase  of  $285,000  across  the 
entire  eligible  population  of  29,760  implies  a  per  enrollee  cost 
of  $9.58  (=  285,000/29,760).  This  number  is  comparable  to  the 
numbers  reported  in  the  Utah  evaluation. 

The  last  row  of  Table  A-1  contains  the  cost  estimates 
(rounded  to  the  nearest  dollar)  implied  by  the  results  reported 
in  Table  4.  While  the  Long/Settle  cost  estimates  bear  some  rough 
similarity  to  the  (corrected  and  revised)  Utah  cost  estimates 
(reported  in  row  3  of  Table  A-1),  they  nevertheless  portray  CM  as 
a  substantially  more  costly  program,  at  least  in  connection  with 
the  three  services  where  direct  comparisons  are  possible.  For 
physician  services,  the  Utah  estimate  implies  a  cost  increase  of 
approximately  $89,000,  while  the  Long/Settle  estimate  suggests  an 
increase  in  program  costs  of  about  $327,000.  In  connection  with 
drugs,  the  Utah  estimate  implies  a  program  savings  of  nearly 
$30,000;  in  contrast,  the  Long/Settle  estimate  indicates  that 
program  costs  should  rise  by  almost  $298,000.  Finally,   the 
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savings  in  outlays  on  OPD  services  implied  by  the  Utah  estimate 
is  approximately  $387,000,  whereas  the  Long/Settle  estimate 
suggests  an  overall  cost  savings  of  much  less,  somewhere  around 
$60,000  per  year.  On  balance,  for  these  three  services,  the  Utah 
findings  show  a  total  program  savings  of  slightly  more  than 
$327,000  annually,  while  the  Long/Settle  results  reveal  an 
increase  in  total  program  costs  of  more  than  $565,000  per  year. 
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■^The  waiver  renewal  application  is  dated  January  23,  1984. 
It  was  submitted  by  Carol  J.  Thomas,  Program  Director,  to  Darrel 
Muhr,  Associate  Regional  Administrator,  Division  of  Program 
Operations.  Utah's  initial  evaluation  of  its  f reedom-of -cho  ice 
program  accompanied  the  application.  Additional  information  was 
submitted  by  Utah  to  Elmer  Smith,  HCFA;  no  date  was  indicated  on 
this    supporting   material. 

^The  evaluation  states  that  $4.40  is  saved  for  every  $1.00 
in  administrative  expenses.  However,  their  own  numbers  make  it 
clear  that  their  findings  are  most  appropriately  described  as 
showing  a  savings  of  $5.40  per  $1.00  spent,  not  $4.40.  (See  page 
6    of    the    Utah    evaluation.) 

^The  potential  significance  of  the  problem  is  easily 
illustrated  however.  Both  the  original  and  the  "corrected" 
estimates  reported  in  Table  1  (see  the  first  two  rows  of 
estimates)  are  based,  in  part,  on  the  apparent  erroneous  data  on 
the  number  of  users  of  lab  and  x-ray  services  in  Weber 
County.  Thus,  the  estimate  of  an  overall  cost  savings  of  $59  per 
client  depends  partly  on  the  assumption  that  the  number  of  lab 
and  x-ray  users  in  Weber  County  fell  from  2234  in  FY  1982  to  721 
in  FY  1983.  Based  upon  the  experience  of  the  neighboring 
counties,  it  is  far  more  reasonable  to  assume  that  the  number  of 
users  of  these  services  did  not  decline  at  all.  If  in  fact  this 
was  what  happened,  the  Utah  evaluation  should  have  reported  an 
overall   cost   savings   of   $71  per   client,    rather    than   $59  per  client. 
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^For  example,  the  data  employed  in  the  Utah  evaluation 
pertain  not  only  to  the  case  managed  population,  but  also  to  some 
subpopulat ions  (such  as  General  Assistance  recipients)  not  even 
eligible  for  case  management.  Further,  the  evaluation  does  not 
consider  the  fact  that  case  management  covered  only  a  fraction  of 
the  potential  case-managed  population  during  the  time  period 
covered  by  the  analysis.  The  two  foregoing  problems  interfere 
with  measuring  accurately  the  effect  of  case  management.  Another 
potentially  important  problem  stems  from  the  method  Utah  employed 
for  forecasting  what  expenditures  per  person  would  have  been  in 
FY  1983  in  the  absence  of  case  management.  The  evaluation  simply 
extrapolates  the  FY  1982  cost  figures  by  applying  an  inflation 
factor  to  them.  These  extrapolated  figures  are  them  compared  to 
the  actual  FY  1983  cost  figures  to  arrive  at  the  estimated  impact 
of  case  management.  This  approach  depends  on  the  highly 
questionable  assumption  that  all  observed  differences  between 
actual  and  predicted  FY  1983  costs  are  attributable  to  case 
management. 

^The  Utah  evaluation  actually  reports  an  expenditure  figure 
of  $101.  However,  correct  addition  of  the  numbers  in  the 
evaluation  yields  $100. 


APPENDIX  B 
CONSTRUCTION  OF  THE  ANALYSIS  FILES 

I.  IMPLICATIONS  OF  THE  RESEARCH  DESIGN  FOR  DATABASE  CONSTRUCTION 

Utah  began  its  Case  Management  Program  for  Medicaid  clients 
in  July  1982  in  four  counties:  Utah,  Salt  Lake,  Weber,  and  Davis, 
all  in  the  Salt  Lake  City  metropolitan  area.  The  actual  program 
was  preceded  by  a  pilot  program  in  Ogden  County  that  began  in 
December  of  the  previous  year.  Between  July  and  October  1982, 
only  new  clients  were  enrolled,  and  all  efforts  were  directed 
toward  enrollment  for  the  subsequent  year.  No  reviews  of  case 
management  status  were  conducted  until  November  1983. 

A  cross-sectional  research  design  is  used  in  the  present 
study,  focusing  on  individual  clients  and  on  utilization  of 
services  and  expenditures  by  those  included  in  case  management 
versus  those  who  were  not  included.  Since  the  principal  vehicles 
of  the  analysis  are  utilization  and  expenditure  equations,  detail 
is  required  on  spending  by  type  of  service  and  by  type  of 
provider.   The  Utah  data  are  rich  in  such  service-level  detail. 

In  addition,  detail  on  individual  characteristics  of  clients 
are  required  to  control  for  the  possibility  that  recruitment  to 
case  management  is  related  to  characteristics  that  are  themselves 
related  to  use  of  medical  care  services.  Such  characteristics 
include  demographic  var iables--f or  example,  age,  sex  and  race- 
ethnic  i  ty--and  use  of  medical  services  prior  to  the  analysis 
period.  The  latter  variable  may  be  considered  in  part  as  a  proxy 
for  health  status  information  not  available  on  the  data  set. 
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II.  THE  DATA 

The  cross-sectional  design  of  the  analysis  requires  two 
types  of  files:  a  service-level  file,  containing  a  record  for 
each  service  used  by  each  recipient  of  services,  and  a  person- 
level  file  containing  a  single  record  for  each  person  that 
describes  characteristics  of  that  person.  The  Medicaid 
Management  Information  System  (MMIS)  data  obtained  from  the  Utah 
program  were  not  at  either  level.  Rather,  they  were  at  claims 
level,  so  that  each  person  might  have  numerous  claim  records.  On 
the  one  hand,  some  claim  records  contained  numerous  individual 
services.  On  the  other  hand,  for  some  individual  services  there 
were  several  claims,  reflecting  adjustments  to  an  original  claim. 
This  meant  that  data  on  individual  characteristics  had  to  be 
stripped  off  and  aggregated  into  a  person  file  containing  only 
one  record  per  unique  recipient,  while  data  relating  to  services 
used  had  to  be  stripped  off  and  either  disaggregated  or 
aggregated  to  the  individual  service  level.  Such  a  level  of 
service  disaggregation  allows  maximum  flexibility  in  the  choice 
of  analysis  unit. 

In  addition,  the  data--which  contained  a  total  of  5.2 
million  claim-level  records--came  from  two  partially  overlapping 
MMIS  periods,  each  with  its  own  data  elements  and  file  layouts. 
Case  management  information  was  available  only  on  records  entered 
under  the  new  system. 

The  2.05  million  records  formatted  under  the  new  system 
spanned  a  period  from  approximately  August  1982  through  August 
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1984  and  represented  service  dates  from  roughly  September  1982 
through  April  1984.  The  distribution  of  these  claims  records  by 
year  is  as  follows: 

Year  Number  of  Claims 

1982  261,965 

1983  1,287,261 

1984  494,527 

Only  records  entered  after  August  1983  contained  information  on 
enrollment  in  case  management,  however. 

These  records  were  of  six  different  types,  only  three  of 
wh i ch--med ica 1 ,  institutional,  and  pharmaceut i ca l--act u a  1 ly 
contain  service  utilization  and  expenditure  information.  Other 
claims  interleaved  with  the  utilization  identified  information  on 
mass  adjustments  of  reimbursements,  presence  of  prior 
authorization  of  services,  and  cases  in  which  Medicare  is  the 
first  payer.  The  breakdown  of  claims  for  the  new  system  by  type 
of  claim  is  as  follows: 

Type  of  Claim  Number  of  Claims 

Medical  683,077 

Institutional  119,482 

Pharmaceutical  1,071,969 

Other  179,225 

III.  THE  TIME  FRAME 

Ideally,  an  enrollment  file  would  be  used  to  identify 
persons  eligible  for  Medicaid  but  using  no  services.   However,  an 
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enrollment  file  was  not  available,  so  the  person-level  file 
described  above,  which  is  really  a  recipient  file,  was  the 
closest  possible  approximation.  In  order  to  be  able  to  draw  both 
users  and  "nonusers"  of  services  from  such  a  file,  it  was 
necessary  to  define  a  time  period  for  analysis  during  which  some 
recipients  could  be  observed  using  services  and  others  could  be 
inferred  to  be  enrolled  but  not  using  services. 

In  order  to  select  a  time  period  suitable  for  analysis,  it 
was  necessary  to  find  a  time  "frame"  during  which  case  management 
was  in  effect  and  an  analysis  "window"  within  the  chosen  frame. 
This  allowed  observation  both  of  persons  who  used  services  during 
the  analysis  window  and  of  persons  who  appeared  to  be  eligible 
but  used  no  services.  The  analysis  window  selected  was  December 
1983,  the  most  recent  month  both  preceded  and  followed  by  three 
complete  months  of  data--the  frame  for  the  analysis  window. 

This  strategy  allowed  inclusion  of  1)  users,  defined  as 
those  with  paid  claims  in  the  December  1983  window,  and  2) 
nonusers,  defined  as  those  who  used  services  at  some  time  in  both 
the  preceding  three  months  and  the  following  three  months  but  who 
used  no  services  in  December  1983.  The  logic  behind  such  a 
definition  of  nonusers  was  that  if  an  individual  was  observed 
using  services  within  a  reasonably  narrow  period  both  prior  to 
and  after  December,  then  eligibility  for  Medicaid  was  likely  to 
have  spanned  December.  The  number  of  claim-level  records 
remaining  by  type  of  record  after  the  time  frame  was  defined  is 
as  follows: 


Type  of  Record  Number  of  Record 
Medical  222,687 

Institutional  8,258 

Pharmacy  231,994 

Other  2,141 

IV.    THE    PROCESS    OF    CONSTRUCTING    PERSON    RECORDS 

Since  the  Utah  data  initially  were  at  claim  level,  person- 
level  files  had  to  be  constructed  using  a  recipient 
identification  number  included  in  each  claim  record.  Where  each 
personal  characteristic  variable  has  a  single  value  across  all 
claims  for  a  given  individual,  this  process  is  a  relatively 
simple  one.  However,  values  were  not  always  consistent  across 
claims  where  individuals  had  multiple  claim  records.  Such 
inconsistencies  could  result,  for  example,  because  some  data 
items  were  omitted  from  some  claims  or  because  of  key-punching 
errors.  In  such  cases,  routines  had  to  be  developed  for  locating 
and  flagging  inconsistencies  so  the  analysts  could  make  a 
decision  as  to  whether  a  single  "clean"  value  reasonably  could  be 
assigned    for    a    given    recipient    identification    number. 

The  following  are  the  personal  characteristic  variables 
constructed  for  the  per s ona 1 - 1 e ve  1  files,  with  a  brief 
description  of  the  type  of  inconsistencies  that  occurred  for  each 
and  the  way  in  which  inconsistent  values  were  coded.  If  all 
cases  with  inconsistencies  are  included,  there  are  15,186 
potential    members    of    the    final    recipient    file.       The    ultimate    size 
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of  the  recipient  file  will  depend  on  the  stringency  of  selection 
criteria  used.  About  1,100  individuals  would  be  excluded  if  the 
most  stringent  criteria  are  applied. 

Case  Management;  This  variable  is  a  dummy  variable  having  a 
value  of  one  if  a  person  was  enrolled  in  case  management  and  zero 
otherwise.  Information  from  Utah  program  officials  indicated 
that  no  one  was  removed  from  case  management  during  the  period  of 
interest,  so  all  persons  should  have  had  a  continuous  period  of 
enrollment  once  enrolled.  However,  when  claims  were  arranged 
chronologically,  some  individuals  appeared  to  have  left  case 
management.  In  order  to  locate  such  individuals,  claims  were 
arranged  by  recipient  identification  number  and  by  service  date. 
The  earliest  date  on  which  each  individual  was  identified  as 
having  received  services  under  case  management  was  then  compared 
with  the  latest  date  that  individual  was  identified  as  receiving 
services  but  not  being  enrolled  in  case  management. 
Discrepancies  were  then  flagged.  Only  196  of  15,186  potential 
members  of  the  final  recipient  file  had  a  discrepancy. 

Age :  This  variable  was  constructed  from  date  of  birth 
information  contained  on  claim  records  because  it  appeared  to  be 
more  reliable  than  an  explicit  age  variable  that  also  appeared. 
However,  because  of  the  large  errors  that  could  occur  if  a  single 
digit  of  this  date  was  entered  incorrectly,  even  this  more 
reliable  variable  was  susceptible  to  inconsistencies.  In  order 
to  examine  the  extent  of  the  consistencies,  mean,  median,  modal, 
minimum  and  maximum  dates  were  constructed  for  each  person.   The 
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number  of  person  records  with  inconsistent  birth  dates  ultimately 
will  depend  on  the  decision  rule  selected.  For  example,  one 
possible  rule  is  assign  the  most  frequently  occurring  date  if  it 
also  is  the  median  date.  Under  that  rule,  only  18  cases  would  be 
excluded.  Only  326  potential  members  of  the  person  file  had  any 
type  of  inconsistency. 

Sex ;  Inconsistencies  in  this  variable  included  nonsense 
values,  missing  values,  and  more  than  one  valid  sex  value. 
Because  of  the  number  of  different  types  on  inconsistencies 
possible,  a  variable  was  constructed  that  identifies  the  degree 
of  reliability  of  the  sex  variable.  The  highest  reliability  was 
assigned  to  cases  where  either  male  or  female  was  the  only 
nonmissing  value.  Only  168  cases  failed  to  meet  this  criterion. 
Where  multiple  nonmissing  values  occurred,  two  other  rankings 
were  constructed:  sex  is  recorded  as  male  or  female  on  more  than 
two-thirds  of  the  claims  for  an  individual,  and  sex  is  recorded 
as  male  or  female  on  more  than  half  the  claims  for  an  individual. 
The  final  ranking  was  ties,  for  which  no  reliable  determination 
can  be  made. 

Race/Ethnicity:  The  procedure  used  for  assignment  of 
race/ethnicity  where  inconsistencies  occurred  was  similar  to  that 
just  described  for  the  sex  variable,  except  that  many  more 
categories  of  race/ethnicity  were  included  on  claims  than  are  of 
interest  for  this  analysis.  Once  categories  were  combined  into 
the  four  wanted  for  this  analy s is--wh i te ,  black,  hispanic  origin, 
and  other--recipients  again  were  assigned  a  reliability  ranked 
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value,  with  the  most  restrictive  criterion  being  that  an 
individual  have  only  one  nonmissing  value  for  race/ethnicity. 
Only  368  potential  members  of  the  recipient  file  fail  this 
criterion. 

Aid  Category:  A  decision  was  made  to  include  only 
recipients  eligible  for  Medicaid  because  of  eligibility  for  Aid 
to  Families  with  Dependent  Children  (AFDC).  This  is  the  most 
common  source  of  eligibility  and  selection  of  the  single 
eligibility  group  yields  a  more  homogeneous  sample  of  persons  for 
analysis.  However,  in  some  cases  persons  who  met  the  AFDC 
criterion  also  were  recorded  as  being  eligible  under  another 
program.  Again,  nearly  all  the  potential  members  of  the  final 
recipient  file,  14,162  individuals,  met  the  most  restrictive 
criterion   of   having   only   AFDC   eligibility. 

County  of  Residence  in  December;  Although  each  claim 
contained  information  about  county  residence,  the  research 
strategy  of  constructing  a  set  of  December  users  and  nonusers  of 
services  posed  special  problems  for  assignment  of  a  residence  in 
December.  That  is,  since  nonusers  had  no  December  claims,  a 
December  residence  had  to  be  inferred  by  comparing  claims  on 
either  side  of  December.  In  addition,  since  residence  is  not  a 
fixed  characteristic  like  sex  or  race,  it  is  more  difficult  to 
determine  which  inconsistencies  reflect  actual  changes  of 
residence  and  which  are  simple  errors,  even  for  those  with 
December  claims.  Fortunately,  14,276  persons  had  only  one 
residence    throughout    the    entire    span    of    data.       For    these    persons 
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assignment  was  straightforward.  Among  the  910  cases  with 
multiple  counties  of  residence,  an  additional  749  had  only  one 
residence  during  the  seven-month  analysis  frame.  Of  the 
remaining  161  persons  with  multiple  residences  during  the 
analysis  frame,  52  had  December  claims  from  which  a  "combination" 
residence  value  could  be  determined  directly.  None  of  these 
persons  had  more  than  two  reported  residences  for  December.  The 
remaining  109  "nonusers"  were  assigned  a  combination  December 
residence  based  on  examination  of  the  most  recent  claim  prior  to 
December  and  the  first  claim  after  December. 

Prior  Utilization;  Measures  of  total  expenditures  for  all 
services  in  the  three,  six,  and  nine  month  periods  prior  to 
December  1983  were  created  for  each  case  that  had  been  a  Medicaid 
recipient  for  a  period  in  excess  of  the  respective  number  of 
months.  For  example,  the  six  month  prior  use  variable  is  the  sum 
of  all  paid  claim  amounts,  regardless  of  service  type,  for  the 
period  June  1,  1983  through  November  31,  1983.  The  variable  is 
constructed,  however,  only  for  those  cases  having  one  or  more 
paid  claims  in  the  period  January  1,  1983  through  May  31,  1983. 
The  point  of  this  res  t  r  i  ct  i  on--ana  logous  to  the  use  of  the 
"window"  in  identifying  nonusers  in  December--is  to  distinguish 
the  apparently  continuous  enrollees,  who  should  be  included  in 
the  analysis,  from  those  with  fewer  than  six  months  of 
eligibility,  who  should  be  excluded  in  order  to  have  an  unbiased 
measure  of  prior  use.  The  three,  six,  and  nine  month  variables 
reduce  the  analysis  sample  from  10,889  (after  applying  all  other 


B-10 
exclusions)  to  9,010,  7,899,  and  6,701  respectively.  Therefore, 
the  analyst  must  trade  the  advantage  of  a  longer  prior  use  period 
against  the  disadvantage  of  smaller  samples.  This  report 
concentrates  on  the  six  month  variable;  the  results  are  virtually 
identical  when  either  the  three  or  nine  month  variable  is 
substituted. 
V.  THE  PROCESS  OF  CREATING  CLEAN  CLAIMS  FILES 

The  second  and  by  far  more  difficult  task  in  file 
construction  was  the  cleaning  of  the  service  information 
contained  on  the  original  claim  records.  There  are  two  major 
reasons  why  the  full  claims  file  as  received  was  not  in  a  form 
suitable  for  the  present  analysis  .  First,  the  MMIS  serves 
primarily  an  accounting  function.  Records  of  all  transactions, 
both  debits  and  credits,  relating  to  a  given  claim  are  included. 
Second,  a  number  of  types  of  "claim"  entries  other  than  actual 
paid  claims  appear.  Examples  are  history  records,  records  for 
mass  provider  reimbursement  adjustments  and  records  relating  to 
prior  authorization  of  services.  The  present  analysis  requires  a 
single,  correct  record  for  each  claim. 

The  first  "cleaning"  job  was  the  exclusion  of  all  of  the 
latter  types  of  nonclaim  records,  generally,  the  2,141  "other" 
records  listed  in  the  analysis  frame  table  above,  plus  history 
and  other  non-claim  records  form  the  medical,  institutional  and 
pharmacy  categories. 

Second,  the  auxiliary  r ecords--incorrect  initial  records, 
and  adjustment  records--associated  with  actual  paid  claims  had  to 
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be  stripped  out.  This  task  was  made  more  complicated  because  not 
all  who  entered  correction  records  followed  the  same  routine. 
That  is,  rather  than  having  an  initial  entry,  a  correction  that 
removed  the  initial  entry  and  then  a  third  record  that  entered 
the  correct  claim,  some  corrected  claims  had  two,  four  or  five 
related  entries.  Since  no  general  pattern  appeared  to  identify 
the  correct  claim  from  these  "odd-lot"  entries,  they  were 
excluded.  Only  claims  that  had  never  been  corrected  and  sets  of 
three  entries  from  which  the  correct  final  record  could  be 
identified  readily  were  retained  in  the  sample  from  which  the 
claims  for  analysis  were  drawn.  However,  these  two  categories 
included  easily  the  bulk  of  claims  in  the  analysis  frame.  Of  the 
465,000  claims  in  the  analysis  frame,  430,215  were  correct  single 
claim  records,  and  another  26,193  represented  sets  of  three,  from 
which  8,731  final  corrected  claims  were  selected. 

The  final  task  in  creation  of  the  service-level  file  for 
analysis  was  disaggregation  of  each  claim  record  into  a  set  of 
single  service  records  containing  information  about  the  service 
used,  the  date  of  service,  the  type  of  provider,  and  the  amount 
of  payment.  This  process  can  best  be  understood  by  understanding 
the  structure  of  a  claim  record.  Each  claim  record  contains  a 
"  f r on t -end-header "  that  identifies  the  recipient  and  other 
information  that  pertains  to  the  entire  record.  After  this 
header,  one  or  more  repeating  segments  may  occur,  each  relating 
to  a  particular  service  included  in  the  single  billing 
represented  by  the  claim  record.   Thus,  the  length  of  each  claim 
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record  varies  depending  on  the  number  of  services  included  in  the 
billing.  Disaggregation  entailed  stripping  off  the  front  end 
header,  stripping  off  each  of  the  repeating  segments  and  then 
reattaching  a  copy  of  the  front  end  header  to  each  individual 
service  segment  to  create  a  new  record  for  each  service.  This 
level  of  disaggregation  allows  reaggregation  for  analysis  to  any 
level  chosen  by  the  analyst,  for  instance,  by  date,  by  type  of 
service,  by  provider  type,  and  so  forth. 


Appendix  C 

The   Estimated    Equations 

The  following  tables  report  the  parameters  estimated  from  the 
statistical  models  discussed  in  the  text.  The  first  six  tables  comprise  the 
probit  estimates  of  the  probability  of  using  a  particular  service  during 
December  1983.  The  remaining  six  tables  comprise  the  ordinary  least 
squares  estimates  of  the  level  of  spending  by  users  of  each  service,  where 
spending  is  expressed  in  its  natural  logarithm.  Each  set  of  six  tables  applies 
to  the  following  services,  respectively: 

o  primary  care  physicians 

o  specialty  care  physicians 

o  hospital  outpatient  department  and  emergency  room 

0  prescription  drugs 

o  clinic-based  physicians'  services 

o  hospital-based  physicians'  services 
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